Jun 16 18:29:45 devstack cinder-volume[81164]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:29:45 devstack cinder-volume[81164]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:29:45 devstack cinder-volume[81164]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:29:46 devstack cinder-volume[81164]: INFO dbcounter [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Registered counter for database cinder
Jun 16 18:29:46 devstack cinder-volume[81164]: DEBUG oslo_db.sqlalchemy.engines [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:29:46 devstack cinder-volume[81164]: DEBUG dbcounter [-] [81164] Writer thread running {{(pid=81164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 16 18:29:46 devstack cinder-volume[81164]: INFO cinder.rpc [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 16 18:29:46 devstack cinder-volume[81164]: INFO cinder.rpc [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 16 18:29:46 devstack cinder-volume[81164]: DEBUG oslo_db.sqlalchemy.engines [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:29:46 devstack cinder-volume[81164]: INFO cinder.volume.manager [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Determined volume DB was empty at startup.
Jun 16 18:29:46 devstack cinder-volume[81164]: DEBUG cinder.volume.manager [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81164) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 16 18:29:46 devstack cinder-volume[81164]: INFO cinder.volume.manager [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 16 18:29:46 devstack cinder-volume[81164]: WARNING stevedore.named [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 16 18:29:46 devstack cinder-volume[81164]: WARNING castellan.key_manager [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:29:46 devstack cinder-volume[81164]: WARNING cinder.keymgr.conf_key_mgr [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:29:46 devstack cinder-volume[81164]: DEBUG cinder.volume.drivers.lvm [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81164) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_concurrency.processutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_concurrency.processutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] CMD "cinder-rtstool verify" returned: 0 in 0.419s {{(pid=81164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_db.sqlalchemy.engines [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:29:47 devstack cinder-volume[81164]: INFO cinder.rpc [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 16 18:29:47 devstack cinder-volume[81164]: INFO cinder.rpc [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 16 18:29:47 devstack cinder-volume[81164]: WARNING stevedore.named [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 16 18:29:47 devstack cinder-volume[81164]: WARNING castellan.key_manager [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:29:47 devstack cinder-volume[81164]: INFO cinder.volume.manager [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_db.sqlalchemy.engines [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:29:47 devstack cinder-volume[81164]: INFO oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Starting 1 workers
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Started child 81335 {{(pid=81164) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Full set of CONF: {{(pid=81164) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] ******************************************************************************** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Configuration options gathered from: {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] ================================================================================ {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] allow_availability_zone_fallback = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] allow_compression_on_image_upload = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] allowed_direct_url_schemes     = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] api_rate_limit                 = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] auth_strategy                  = keystone {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] az_cache_duration              = 3600 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_availability_zone      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_host                   = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_name                   = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_stats_polling_interval = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backup_api_class               = cinder.backup.api.API {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backup_name_template           = backup-%s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backup_use_same_host           = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backup_use_temp_snapshot       = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] chap_password                  = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] chap_username                  =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_internal_tenant_project_id = a8f678e9c359415585e6fc7beaad191d {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_internal_tenant_user_id = 90f5cafdb1344ff2b833a00ab22a7091 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cloned_volume_same_az          = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cluster                        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] compression_format             = gzip {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] config_dir                     = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] config_source                  = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] control_exchange               = openstack {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] debug                          = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] default_availability_zone      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] default_group_type             = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] default_volume_type            = lvmdriver-1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] disk_geometry                  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] driver_client_cert             = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] driver_client_cert_key         = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] driver_data_namespace          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] driver_ssl_cert_path           = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] driver_ssl_cert_verify         = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] driver_use_ssl                 = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] enable_force_upload            = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] enable_new_services            = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] enable_unsupported_driver      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] enforce_multipath_for_image_xfer = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] filter_function                = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_api_insecure            = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_api_servers             = ['http://192.168.122.236/image'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_api_ssl_compression     = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_ca_certificates_file    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_certfile                = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_keyfile                 = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_num_retries             = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance_request_timeout         = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] goodness_function              = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] graceful_shutdown_timeout      = 5 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] group_api_class                = cinder.group.api.API {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] host                           = devstack {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_compress_on_upload       = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_conversion_address_space_limit = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_conversion_cpu_limit     = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_conversion_disable       = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_upload_use_cinder_backend = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_upload_use_internal_tenant = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_volume_cache_enabled     = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_volume_cache_max_count   = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] image_volume_cache_max_size_gb = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] init_host_max_objects_retrieval = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] iscsi_target_flags             =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] iscsi_write_cache              = on {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] iser_helper                    = tgtadm {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] iser_ip_address                = 192.168.122.236 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81335]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] iser_port                      = 3260 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_color                      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_config_append              = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_dir                        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_file                       = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack sudo[81339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_options                    = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_rotate_interval            = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_rotate_interval_type       = days {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] log_rotation_type              = none {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack sudo[81339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] max_age                        = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] max_logfile_count              = 30 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] max_logfile_size_mb            = 200 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] max_over_subscription_ratio    = 20.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] message_reap_interval          = 86400 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] message_ttl                    = 2592000 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] migration_create_volume_timeout_secs = 300 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] monkey_patch                   = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] monkey_patch_modules           = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] my_ip                          = 192.168.122.236 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] no_snapshot_gb_quota           = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] num_iser_scan_tries            = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] num_shell_tries                = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] num_volume_device_scan_tries   = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] nvmeof_conn_info_version       = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] nvmet_ns_id                    = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] nvmet_port_id                  = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_max_limit                = 1000 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_volume_ext_list          = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_volume_listen_port       = 8776 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_volume_use_ssl           = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] osapi_volume_workers           = 2 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] per_volume_size_limit          = -1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] periodic_fuzzy_delay           = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] periodic_interval              = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] public_endpoint                = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] publish_errors                 = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_backup_gigabytes         = 1000 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_backups                  = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_gigabytes                = 1000 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_groups                   = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_snapshots                = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] quota_volumes                  = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] rate_limit_burst               = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] rate_limit_except_level        = CRITICAL {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] rate_limit_interval            = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] reinit_driver_count            = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] replication_device             = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] report_discard_supported       = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] report_interval                = 120 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] reservation_clean_interval     = 86400 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] reservation_expire             = 86400 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] reserved_image_namespaces      = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] reserved_percentage            = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] rpc_response_timeout           = 120 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] run_external_periodic_tasks    = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] scst_target_driver             = iscsi {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] scst_target_iqn_name           = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_down_time              = 720 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] shell_completion               = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] snapshot_name_template         = snapshot-%s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] snapshot_same_host             = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] split_loggers                  = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] state_path                     = /opt/stack/data/cinder {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] storage_availability_zone      = nova {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] storage_protocol               = iSCSI {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] syslog_log_facility            = LOG_USER {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] target_helper                  = lioadm {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] target_ip_address              = 192.168.122.236 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] target_port                    = 3260 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] target_protocol                = iscsi {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] target_secondary_ip_addresses  = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] trace_flags                    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] transport_url                  = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] until_refresh                  = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_chap_auth                  = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_default_quota_class        = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_journal                    = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_json                       = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_multipath_for_image_xfer   = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_stderr                     = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] use_syslog                     = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] verify_glance_signatures       = enabled {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_api_class               = cinder.volume.api.API {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_backend_name            = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_clear                   = zero {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_clear_ionice            = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_clear_size              = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_copy_bps_limit          = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_dd_blocksize            = 1M {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_name_template           = volume-%s {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_service_inithost_offload = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volume_usage_audit_period      = month {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] zoning_mode                    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_concurrency.disable_process_locking = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.admin_password = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.admin_token = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.admin_user  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_protocol = https {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_section = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_type   = password {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_uri    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.auth_version = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.cache       = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.certfile    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.identity_uri = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.include_service_catalog = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:47 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.insecure    = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.interface   = public {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.keyfile     = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_password =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcache_username =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.region_name = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.service_type = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: INFO cinder.volume.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.236/identity {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.backend                  = dogpile.cache.null {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.backend_argument         = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.backend_expiration_time  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.config_prefix            = cache.oslo {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.debug_cache_backend      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.enable_retry_client      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.enable_socket_keepalive  = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.enabled                  = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.enforce_fips_mode        = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.expiration_time          = 600 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.hashclient_retry_attempts = 2 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_dead_retry      = 300 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_sasl_enabled    = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.password                 = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.proxies                  = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.redis_db                 = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.redis_server             = localhost:6379 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.retry_attempts           = 2 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.retry_delay              = 0.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.socket_keepalive_count   = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.socket_keepalive_idle    = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.socket_keepalive_interval = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.socket_timeout           = 1.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.tls_allowed_ciphers      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.tls_cafile               = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.tls_certfile             = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.tls_enabled              = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.tls_keyfile              = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cache.username                 = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.asyncio_connection    = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.asyncio_slave_connection = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.backend               = sqlalchemy {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.connection            = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.connection_debug      = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.connection_parameters =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.connection_recycle_time = 3600 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.connection_trace      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.db_inc_retry_interval = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.db_max_retries        = 20 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.db_max_retry_interval = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.db_retry_interval     = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.max_overflow          = 50 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.max_pool_size         = 5 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.max_retries           = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.mysql_wsrep_sync_wait = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.pool_timeout          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.retry_interval        = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.slave_connection      = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.sqlite_synchronous    = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.synchronous_reader    = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] database.use_db_reconnect      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.connection_string     = messaging:// {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.enabled               = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.es_doc_type           = notification {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.es_scroll_size        = 10000 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.es_scroll_time        = 2m {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.filter_error_trace    = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.hmac_keys             = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.sentinel_service_name = mymaster {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.socket_timeout        = 0.1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.trace_requests        = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler.trace_sqlalchemy      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler_jaeger.process_tags   = {} {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler_jaeger.service_name_prefix = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] profiler_otlp.service_name_prefix = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.enforce_new_defaults = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: WARNING oslo_config.cfg [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.enforce_scope      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.policy_default_rule = default {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] coordination.backend_url       = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.group          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.helper_command = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] privsep_osbrick.user           = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.group         = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.helper_command = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] cinder_sys_admin.user          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.auth_section      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.auth_type         = password {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.cafile            = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.certfile          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.collect_timing    = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.insecure          = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.keyfile           = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.send_service_user_token = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.split_loggers     = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] service_user.timeout           = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.auth_section            = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.auth_type               = password {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.certfile                = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.collect_timing          = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.insecure                = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.keyfile                 = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.region_name             = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.split_loggers           = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] glance.timeout                 = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.backend_availability_zone = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.chap_password = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.chap_username =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.disk_geometry = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.driver_client_cert = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.driver_client_cert_key = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.driver_data_namespace = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.driver_use_ssl = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.extra_capabilities = {} {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.filter_function = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.goodness_function = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.iscsi_target_flags =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.iscsi_write_cache = on {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.iser_ip_address = 192.168.122.236 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.iser_port     = 3260 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.lvm_share_target = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.lvm_type      = auto {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.num_shell_tries = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.replication_device = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.report_discard_supported = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.reserved_percentage = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.target_helper = tgtadm {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.target_ip_address = 192.168.122.236 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.target_port   = 3260 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.target_protocol = iscsi {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.trace_flags   = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.unique_fqdn_network = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.use_chap_auth = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_backend_name = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_clear  = zero {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_clear_ionice = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_clear_size = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_reports.file_event_handler = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_reports.log_dir           = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.backend_host       = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.chap_password      = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.chap_username      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.disk_geometry      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.driver_client_cert = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.extra_capabilities = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.filter_function    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.goodness_function  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.iser_helper        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.iser_ip_address    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.iser_port          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.lvm_share_target   = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.lvm_type           = auto {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.num_shell_tries    = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.replication_device = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.report_discard_supported = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.reserved_percentage = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.scst_target_driver = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.storage_protocol   = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.target_helper      = lioadm {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.target_ip_address  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.target_port        = 3260 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.trace_flags        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.use_chap_auth      = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_clear       = zero {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_clear_size  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] lvmdriver-1.volumes_dir        = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_notifications.driver = [] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_notifications.retry = -1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] key_manager.fixed_key          = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.barbican_api_version  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.barbican_endpoint     = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.barbican_endpoint_type = public {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.barbican_region_name  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.cafile                = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.certfile              = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.collect_timing        = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.insecure              = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.keyfile               = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.number_of_retries     = 60 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.retry_delay           = 1 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.send_service_user_token = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.split_loggers         = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.timeout               = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.verify_ssl            = True {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican.verify_ssl_path       = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.auth_section = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.auth_type = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.cafile   = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.certfile = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.collect_timing = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.insecure = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.keyfile  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.split_loggers = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] barbican_service_user.timeout  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.approle_role_id          = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.approle_secret_id        = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.kv_mountpoint            = secret {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.kv_path                  = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.kv_version               = 2 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.namespace                = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.root_token_id            = **** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.ssl_ca_crt_file          = None {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.timeout                  = 60.0 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.use_ssl                  = False {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:29:48 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] ******************************************************************************** {{(pid=81164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 16 18:29:48 devstack sudo[81339]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.807s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:48 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:48 devstack sudo[81399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:48 devstack sudo[81399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:49 devstack sudo[81399]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.564s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:29:49 devstack cinder-volume[81335]: INFO cinder.brick.local_dev.lvm [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:49 devstack sudo[81643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:29:49 devstack sudo[81643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:49 devstack sudo[81643]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG cinder.brick.local_dev.lvm [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81335) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 16 18:29:49 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:49 devstack sudo[81826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:49 devstack sudo[81826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:51 devstack sudo[81826]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:51 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.455s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:51 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:51 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:51 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:51 devstack sudo[82094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:51 devstack sudo[82094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:52 devstack sudo[82094]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:52 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.911s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:52 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:52 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:52 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:52 devstack sudo[82119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 16 18:29:52 devstack sudo[82119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:52 devstack sudo[82119]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:52 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.610s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:52 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:52 devstack sudo[82122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:29:52 devstack sudo[82122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:53 devstack sudo[82122]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:53 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:53 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:53 devstack sudo[82127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:29:53 devstack sudo[82127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:54 devstack sudo[82127]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:54 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:54 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:54 devstack sudo[82130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:29:54 devstack sudo[82130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:54 devstack sudo[82130]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:54 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:54 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:54 devstack sudo[82138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:54 devstack sudo[82138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:55 devstack sudo[82138]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:55 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.746s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:55 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:55 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:55 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:55 devstack sudo[82143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:55 devstack sudo[82143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:56 devstack sudo[82143]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:56 devstack cinder-volume[81335]: INFO cinder.volume.drivers.lvm [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:56 devstack sudo[82151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:56 devstack sudo[82151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:56 devstack sudo[82151]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:29:56 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:56 devstack sudo[82225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:29:56 devstack sudo[82225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:57 devstack sudo[82225]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:57 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:57 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:57 devstack sudo[82269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:29:57 devstack sudo[82269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:57 devstack cinder-volume[81164]: DEBUG dbcounter [-] [81164] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:29:58 devstack sudo[82269]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:58 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:58 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:58 devstack sudo[82413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:29:58 devstack sudo[82413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:58 devstack sudo[82413]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:58 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:58 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:58 devstack sudo[82417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:29:58 devstack sudo[82417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:59 devstack sudo[82417]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:59 devstack cinder-volume[81335]: INFO cinder.volume.driver [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Driver hasn't implemented _init_vendor_properties()
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG cinder.volume.driver [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81335) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG oslo_db.sqlalchemy.engines [None req-18a74046-83d0-4316-8916-e71f27698723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG dbcounter [-] [81335] Writer thread running {{(pid=81335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG cinder.db.sqlalchemy.api [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Building query based on filter {{(pid=81335) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}}
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG cinder.image.image_utils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81335) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 16 18:29:59 devstack cinder-volume[81335]: INFO cinder.keymgr.migration [None req-d42e4107-665f-4749-8f36-fc5c64ab833b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:59 devstack sudo[82421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:29:59 devstack sudo[82421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:29:59 devstack sudo[82421]: pam_unix(sudo:session): session closed for user root
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:29:59 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:29:59 devstack sudo[82424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:29:59 devstack sudo[82424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:00 devstack sudo[82424]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:00 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:00 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:30:00 devstack sudo[82427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:30:00 devstack sudo[82427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:01 devstack sudo[82427]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:30:01 devstack sudo[82430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:30:01 devstack sudo[82430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:01 devstack sudo[82430]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG cinder.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Notifying Schedulers of capabilities ... {{(pid=81335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:30:01 devstack cinder-volume[81335]: INFO cinder.volume.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Driver initialization completed successfully.
Jun 16 18:30:01 devstack cinder-volume[81335]: INFO cinder.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Initiating service 2 cleanup
Jun 16 18:30:01 devstack cinder-volume[81335]: INFO cinder.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Service 2 cleanup completed.
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG cinder.service [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Creating RPC server for service cinder-volume {{(pid=81335) start /opt/stack/cinder/cinder/service.py:231}}
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG cinder.service [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81335) start /opt/stack/cinder/cinder/service.py:237}}
Jun 16 18:30:01 devstack cinder-volume[81335]: INFO cinder.volume.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:30:01 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:30:01 devstack sudo[82437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:30:01 devstack sudo[82437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:02 devstack sudo[82437]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:02 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:02 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:30:02 devstack sudo[82441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:30:02 devstack sudo[82441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:03 devstack sudo[82441]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:03 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:03 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:30:03 devstack sudo[82445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:30:03 devstack sudo[82445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:03 devstack sudo[82445]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:03 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:03 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:30:03 devstack sudo[82448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:30:03 devstack sudo[82448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:30:04 devstack sudo[82448]: pam_unix(sudo:session): session closed for user root
Jun 16 18:30:04 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-18a74046-83d0-4316-8916-e71f27698723 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:30:04 devstack cinder-volume[81335]: INFO cinder.volume.manager [None req-18a74046-83d0-4316-8916-e71f27698723 None None] Driver post RPC initialization completed successfully.
Jun 16 18:30:04 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager._thread_info {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:30:04 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread count: 6 {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:30:04 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread info: [<_MainThread(MainThread, started 136252004294784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136251895284608)>, <Thread(Thread-3 (stat_writer), started daemon 136251895058816)>, <Thread(Rabbit-heartbeat, started daemon 136251902600064)>, <Thread(Thread-5 (_runner), started daemon 136251892497024)>, <Thread(Thread-7 (_runner), started daemon 136251892532800)>] {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:30:14 devstack cinder-volume[81335]: DEBUG dbcounter [-] [81335] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:30:14 devstack cinder-volume[81335]: DEBUG dbcounter [-] [81335] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=81335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:31:04 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:31:04 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:31:04 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:31:04 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:31:04 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:31:05 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Jun 16 18:31:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:31:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:31:05 devstack sudo[84670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:31:05 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:31:05 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root
Jun 16 18:31:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:31:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:31:05 devstack sudo[84700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:31:05 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:31:06 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:31:06 devstack sudo[84703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:31:06 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:31:06 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG cinder.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Notifying Schedulers of capabilities ... {{(pid=81335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager._thread_info {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread count: 6 {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:31:06 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread info: [<_MainThread(MainThread, started 136252004294784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136251895284608)>, <Thread(Thread-3 (stat_writer), started daemon 136251895058816)>, <Thread(Rabbit-heartbeat, started daemon 136251902600064)>, <Thread(Thread-5 (_runner), started daemon 136251892497024)>, <Thread(Thread-7 (_runner), started daemon 136251892532800)>] {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:32:04 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:32:04 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:32:04 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:32:04 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:32:04 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:32:05 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Jun 16 18:32:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:32:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:32:05 devstack sudo[87561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:32:05 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:32:05 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root
Jun 16 18:32:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:32:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:32:05 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:32:05 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:32:06 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:32:06 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:32:06 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:32:06 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG cinder.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Notifying Schedulers of capabilities ... {{(pid=81335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager._thread_info {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread count: 6 {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:32:06 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread info: [<_MainThread(MainThread, started 136252004294784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136251895284608)>, <Thread(Thread-3 (stat_writer), started daemon 136251895058816)>, <Thread(Rabbit-heartbeat, started daemon 136251902600064)>, <Thread(Thread-5 (_runner), started daemon 136251892497024)>, <Thread(Thread-7 (_runner), started daemon 136251892532800)>] {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:32:14 devstack cinder-volume[81335]: DEBUG dbcounter [-] [81335] Writing DB stats cinder:SELECT=1 {{(pid=81335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:32:14 devstack cinder-volume[81335]: DEBUG dbcounter [-] [81335] Writing DB stats cinder:UPDATE=1 {{(pid=81335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:33:04 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:33:04 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:33:04 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:33:04 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:33:04 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:33:05 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Jun 16 18:33:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:33:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:33:05 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:33:05 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:33:05 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Jun 16 18:33:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:33:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:33:05 devstack sudo[89434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:33:05 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:33:06 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root
Jun 16 18:33:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:33:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:33:06 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:33:06 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:33:06 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Jun 16 18:33:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:33:06 devstack cinder-volume[81335]: DEBUG cinder.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Notifying Schedulers of capabilities ... {{(pid=81335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:34:04 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:34:04 devstack cinder-volume[81335]: DEBUG cinder.volume.drivers.lvm [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Updating volume stats {{(pid=81335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 16 18:34:04 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:04 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 16 18:34:04 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:05 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.563s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:05 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:34:05 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:05 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:05 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:05 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 16 18:34:05 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:06 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.553s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:06 devstack sudo[90650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 16 18:34:06 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:06 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG oslo_concurrency.processutils [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=81335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG cinder.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Notifying Schedulers of capabilities ... {{(pid=81335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG oslo_service.periodic_task [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] Running periodic task VolumeManager._thread_info {{(pid=81335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread count: 6 {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:34:06 devstack cinder-volume[81335]: DEBUG cinder.volume.manager [None req-dc3abea5-9bc2-4bc9-a4c1-f6113aeffdd5 None None] thread info: [<_MainThread(MainThread, started 136252004294784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136251895284608)>, <Thread(Thread-3 (stat_writer), started daemon 136251895058816)>, <Thread(Rabbit-heartbeat, started daemon 136251902600064)>, <Thread(Thread-5 (_runner), started daemon 136251892497024)>, <Thread(Thread-7 (_runner), started daemon 136251892532800)>] {{(pid=81335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:34:14 devstack cinder-volume[81335]: DEBUG dbcounter [-] [81335] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:34:16 devstack cinder-volume[81164]: INFO oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Caught SIGTERM, stopping children
Jun 16 18:34:16 devstack cinder-volume[81164]: DEBUG oslo_concurrency.lockutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Acquiring lock "singleton_lock" {{(pid=81164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:34:16 devstack cinder-volume[81164]: DEBUG oslo_concurrency.lockutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Acquired lock "singleton_lock" {{(pid=81164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:34:16 devstack cinder-volume[81164]: DEBUG oslo_concurrency.lockutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Releasing lock "singleton_lock" {{(pid=81164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:34:16 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Stop services. {{(pid=81164) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 16 18:34:16 devstack cinder-volume[81164]: DEBUG oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Killing children. {{(pid=81164) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 16 18:34:16 devstack cinder-volume[81164]: INFO oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Waiting on 1 children to exit
Jun 16 18:34:16 devstack cinder-volume[81335]: DEBUG oslo_concurrency.lockutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Acquiring lock "singleton_lock" {{(pid=81335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:34:16 devstack cinder-volume[81335]: DEBUG oslo_concurrency.lockutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Acquired lock "singleton_lock" {{(pid=81335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:34:16 devstack cinder-volume[81335]: DEBUG oslo_concurrency.lockutils [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Releasing lock "singleton_lock" {{(pid=81335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:34:16 devstack cinder-volume[81335]: WARNING amqp [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 16 18:34:16 devstack cinder-volume[81335]: WARNING amqp [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 16 18:34:16 devstack cinder-volume[81164]: INFO oslo_service.backend._eventlet.service [None req-69b67487-9b5e-4eba-8835-eae34ce52728 None None] Child 81335 exited with status 0
Jun 16 18:34:19 devstack cinder-volume[91035]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:34:19 devstack cinder-volume[91035]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:34:19 devstack cinder-volume[91035]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:34:19 devstack cinder-volume[91035]: INFO dbcounter [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Registered counter for database cinder
Jun 16 18:34:19 devstack cinder-volume[91035]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG dbcounter [-] [91035] Writer thread running {{(pid=91035) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 16 18:34:20 devstack cinder-volume[91035]: INFO cinder.rpc [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 16 18:34:20 devstack cinder-volume[91035]: INFO cinder.rpc [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:20 devstack cinder-volume[91035]: INFO cinder.volume.manager [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Determined volume DB was empty at startup.
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG cinder.volume.manager [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91035) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 16 18:34:20 devstack cinder-volume[91035]: INFO cinder.volume.manager [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 16 18:34:20 devstack cinder-volume[91035]: WARNING stevedore.named [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 16 18:34:20 devstack cinder-volume[91035]: WARNING castellan.key_manager [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:34:20 devstack cinder-volume[91035]: WARNING cinder.keymgr.conf_key_mgr [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:34:20 devstack cinder-volume[91035]: INFO cinder.volume.manager [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:20 devstack cinder-volume[91035]: INFO oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Starting 1 workers
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Started child 91227 {{(pid=91035) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Full set of CONF: {{(pid=91035) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] ******************************************************************************** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Configuration options gathered from: {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] ================================================================================ {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] allow_availability_zone_fallback = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] allow_compression_on_image_upload = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] allowed_direct_url_schemes     = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] api_rate_limit                 = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] auth_strategy                  = keystone {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_availability_zone      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_host                   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_name                   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_stats_polling_interval = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backup_api_class               = cinder.backup.api.API {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backup_name_template           = backup-%s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backup_use_same_host           = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backup_use_temp_snapshot       = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] chap_password                  = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] chap_username                  =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_internal_tenant_project_id = a8f678e9c359415585e6fc7beaad191d {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_internal_tenant_user_id = 90f5cafdb1344ff2b833a00ab22a7091 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cluster                        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] compression_format             = gzip {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] compute_api_class              = cinder.compute.nova.API {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91227]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] config_dir                     = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] config_source                  = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] control_exchange               = openstack {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] debug                          = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] default_availability_zone      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] default_group_type             = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] default_volume_type            = QuobyteHD {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] disk_geometry                  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] driver_client_cert             = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] driver_client_cert_key         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] driver_data_namespace          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] driver_ssl_cert_path           = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] driver_ssl_cert_verify         = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] driver_use_ssl                 = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] enable_new_services            = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] enable_unsupported_driver      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] enabled_backends               = ['QuobyteHD'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] enforce_multipath_for_image_xfer = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] filter_function                = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_api_insecure            = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_api_servers             = ['http://192.168.122.236/image'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_api_ssl_compression     = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_ca_certificates_file    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_catalog_info            = image:glance:publicURL {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_certfile                = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_keyfile                 = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_num_retries             = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance_request_timeout         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] goodness_function              = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] graceful_shutdown_timeout      = 5 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] group_api_class                = cinder.group.api.API {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] host                           = devstack {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_compress_on_upload       = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_conversion_address_space_limit = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_conversion_cpu_limit     = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_conversion_disable       = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_upload_use_cinder_backend = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_upload_use_internal_tenant = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_volume_cache_enabled     = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_volume_cache_max_count   = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] image_volume_cache_max_size_gb = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] init_host_max_objects_retrieval = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] instance_format                = [instance: %(uuid)s]  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] iscsi_target_flags             =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] iscsi_write_cache              = on {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] iser_helper                    = tgtadm {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] iser_ip_address                = 192.168.122.236 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] iser_port                      = 3260 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_color                      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_config_append              = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_dir                        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_file                       = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_options                    = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_rotate_interval            = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_rotate_interval_type       = days {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] log_rotation_type              = none {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] max_age                        = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] max_logfile_count              = 30 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] max_logfile_size_mb            = 200 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] max_over_subscription_ratio    = 20.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] message_reap_interval          = 86400 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] message_ttl                    = 2592000 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] migration_create_volume_timeout_secs = 300 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] monkey_patch                   = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] monkey_patch_modules           = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] my_ip                          = 192.168.122.236 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] no_snapshot_gb_quota           = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] num_iser_scan_tries            = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] num_shell_tries                = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] num_volume_device_scan_tries   = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] nvmeof_conn_info_version       = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] nvmet_ns_id                    = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] nvmet_port_id                  = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_max_limit                = 1000 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_volume_ext_list          = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_volume_listen_port       = 8776 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_volume_use_ssl           = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] osapi_volume_workers           = 2 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] per_volume_size_limit          = -1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] periodic_fuzzy_delay           = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] periodic_interval              = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] public_endpoint                = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] publish_errors                 = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_backup_gigabytes         = 1000 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_backups                  = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_gigabytes                = 1000 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_groups                   = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_snapshots                = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] quota_volumes                  = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] rate_limit_burst               = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] rate_limit_except_level        = CRITICAL {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] rate_limit_interval            = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] reinit_driver_count            = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] replication_device             = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] report_discard_supported       = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] report_interval                = 120 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] reservation_clean_interval     = 86400 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] reservation_expire             = 86400 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] reserved_image_namespaces      = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] reserved_percentage            = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91227]: INFO cinder.volume.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] rpc_response_timeout           = 120 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] run_external_periodic_tasks    = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] scst_target_driver             = iscsi {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] scst_target_iqn_name           = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_down_time              = 720 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] shell_completion               = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] snapshot_name_template         = snapshot-%s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] split_loggers                  = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.remotefs [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91227) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] state_path                     = /opt/stack/data/cinder {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] storage_availability_zone      = nova {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] storage_protocol               = iSCSI {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] syslog_log_facility            = LOG_USER {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] target_helper                  = lioadm {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] target_ip_address              = 192.168.122.236 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] target_port                    = 3260 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] target_protocol                = iscsi {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] target_secondary_ip_addresses  = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] trace_flags                    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] transport_url                  = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] until_refresh                  = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_chap_auth                  = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_default_quota_class        = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_journal                    = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_json                       = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_multipath_for_image_xfer   = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_stderr                     = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] use_syslog                     = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] verify_glance_signatures       = enabled {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_api_class               = cinder.volume.api.API {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_backend_name            = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_clear                   = zero {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_clear_ionice            = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_clear_size              = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_copy_bps_limit          = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_dd_blocksize            = 1M {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_name_template           = volume-%s {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_service_inithost_offload = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volume_usage_audit_period      = month {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] zoning_mode                    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_concurrency.disable_process_locking = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.admin_password = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.admin_token = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.admin_user  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_port   = 35357 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_protocol = https {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_section = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_type   = password {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_uri    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.auth_version = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.cache       = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.certfile    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.identity_uri = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.include_service_catalog = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.insecure    = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.interface   = public {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.keyfile     = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_password =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcache_username =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.region_name = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.service_type = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.236/identity {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.backend                  = dogpile.cache.null {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.backend_argument         = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.backend_expiration_time  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.config_prefix            = cache.oslo {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.debug_cache_backend      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.enable_retry_client      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.enable_socket_keepalive  = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.enabled                  = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.enforce_fips_mode        = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.expiration_time          = 600 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.hashclient_retry_attempts = 2 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_dead_retry      = 300 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_pool_maxsize    = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_sasl_enabled    = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.password                 = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.proxies                  = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.redis_db                 = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.redis_server             = localhost:6379 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.retry_attempts           = 2 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.retry_delay              = 0.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.socket_keepalive_count   = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.socket_keepalive_idle    = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.socket_keepalive_interval = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.socket_timeout           = 1.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.tls_allowed_ciphers      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.tls_cafile               = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.tls_certfile             = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.tls_enabled              = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.tls_keyfile              = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cache.username                 = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.asyncio_connection    = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.asyncio_slave_connection = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.backend               = sqlalchemy {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.connection            = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.connection_debug      = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.connection_parameters =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.connection_recycle_time = 3600 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.connection_trace      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.db_inc_retry_interval = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.db_max_retries        = 20 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.db_max_retry_interval = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.db_retry_interval     = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.max_overflow          = 50 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.max_pool_size         = 5 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.max_retries           = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.mysql_wsrep_sync_wait = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.pool_timeout          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.retry_interval        = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.slave_connection      = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.sqlite_synchronous    = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.synchronous_reader    = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] database.use_db_reconnect      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.connection_string     = messaging:// {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.enabled               = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.es_doc_type           = notification {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.es_scroll_size        = 10000 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.es_scroll_time        = 2m {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.filter_error_trace    = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.hmac_keys             = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.sentinel_service_name = mymaster {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.socket_timeout        = 0.1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.trace_requests        = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler.trace_sqlalchemy      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler_jaeger.process_tags   = {} {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler_jaeger.service_name_prefix = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] profiler_otlp.service_name_prefix = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.enforce_new_defaults = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: WARNING oslo_config.cfg [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.enforce_scope      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.policy_default_rule = default {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.policy_file        = policy.yaml {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] coordination.backend_url       = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.group          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.helper_command = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] privsep_osbrick.user           = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.group         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.helper_command = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] cinder_sys_admin.user          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.auth_section      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.auth_type         = password {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.cafile            = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.certfile          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.collect_timing    = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.insecure          = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.keyfile           = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.send_service_user_token = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.split_loggers     = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] service_user.timeout           = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.auth_section            = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.auth_type               = password {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.certfile                = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.collect_timing          = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.insecure                = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.keyfile                 = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.region_name             = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.split_loggers           = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] glance.timeout                 = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.backend_availability_zone = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.chap_password = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.chap_username =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.disk_geometry = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.driver_client_cert = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.driver_client_cert_key = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.driver_data_namespace = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.driver_use_ssl = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.extra_capabilities = {} {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.filter_function = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.goodness_function = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.iscsi_target_flags =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.iscsi_write_cache = on {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.iser_helper   = tgtadm {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.iser_ip_address = 192.168.122.236 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.iser_port     = 3260 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_host      =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_login     = admin {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_mount_options = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_password  = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_private_key =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_share_path =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.num_shell_tries = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.quobyte_volume_url = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.replication_device = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.report_discard_supported = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.reserved_percentage = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.target_helper = tgtadm {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.target_ip_address = 192.168.122.236 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.target_port   = 3260 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.target_protocol = iscsi {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.trace_flags   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.unique_fqdn_network = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.use_chap_auth = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_backend_name = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_clear  = zero {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_clear_ionice = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_clear_size = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_reports.file_event_handler = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_reports.log_dir           = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.backend_availability_zone = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.backend_host         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.chap_password        = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.chap_username        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.chiscsi_conf         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.disk_geometry        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.driver_client_cert   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.driver_data_namespace = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.driver_use_ssl       = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.extra_capabilities   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.filter_function      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.goodness_function    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.iser_helper          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.iser_ip_address      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.iser_port            = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.iser_target_prefix   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_host             = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_login            = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_mount_options    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_password         = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_private_key      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_share_path       = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_ssh_port         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.num_shell_tries      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.nvmet_port_id        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.replication_device   = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.report_discard_supported = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.reserved_percentage  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.scst_target_driver   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.storage_protocol     = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.target_helper        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.target_ip_address    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.target_port          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.target_prefix        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.target_protocol      = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.trace_flags          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.use_chap_auth        = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_clear         = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_clear_size    = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] QuobyteHD.volumes_dir          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91227) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91227]: WARNING cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91227]: WARNING cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Running cmd (subprocess): mount.quobyte {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.ssl      = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_notifications.driver = [] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_notifications.retry = -1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] key_manager.fixed_key          = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.barbican_api_version  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.barbican_endpoint     = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.barbican_endpoint_type = public {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.barbican_region_name  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.cafile                = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.certfile              = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.collect_timing        = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.insecure              = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.keyfile               = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.number_of_retries     = 60 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.retry_delay           = 1 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.send_service_user_token = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.split_loggers         = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.timeout               = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.verify_ssl            = True {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican.verify_ssl_path       = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.auth_section = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.auth_type = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.cafile   = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.certfile = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.collect_timing = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.insecure = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.keyfile  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.split_loggers = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] barbican_service_user.timeout  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.approle_role_id          = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.approle_secret_id        = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.kv_mountpoint            = secret {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.kv_path                  = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.kv_version               = 2 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.namespace                = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.root_token_id            = **** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.ssl_ca_crt_file          = None {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.timeout                  = 60.0 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.use_ssl                  = False {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:20 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] ******************************************************************************** {{(pid=91035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 16 18:34:20 devstack quobyte-client[91281]: Reading configuration file: /etc/quobyte/client.cfg
Jun 16 18:34:20 devstack quobyte-client[91281]: Invalid parameters found, error: missing mount point.
Jun 16 18:34:20 devstack quobyte-client[91281]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 16 18:34:20 devstack quobyte-client[91281]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:20 devstack cinder-volume[91227]: INFO cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 ...
Jun 16 18:34:20 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 -c /etc/quobyte/client-cinder.cfg {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:20 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 -c /etc/quobyte/client-cinder.cfg
Jun 16 18:34:20 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:21 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:21 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.770s {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:21 devstack cinder-volume[91227]: INFO cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 succeeded
Jun 16 18:34:21 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:21 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.783s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:21 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:21 devstack sudo[91355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:21 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:22 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.563s {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:22 devstack cinder-volume[91227]: INFO cinder.volume.driver [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Driver hasn't implemented _init_vendor_properties()
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.volume.driver [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.722557067871, 'free_capacity_gb': 1775.722557067871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91227) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_db.sqlalchemy.engines [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG dbcounter [-] [91227] Writer thread running {{(pid=91227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.db.sqlalchemy.api [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Building query based on filter {{(pid=91227) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.image.image_utils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91227) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 16 18:34:22 devstack cinder-volume[91227]: INFO cinder.keymgr.migration [None req-0429b5c8-a00f-4bde-a0d9-5cbfa31c8a3f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:22 devstack sudo[91358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:22 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:22 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.571s {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Notifying Schedulers of capabilities ... {{(pid=91227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:34:22 devstack cinder-volume[91227]: INFO cinder.volume.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Driver initialization completed successfully.
Jun 16 18:34:22 devstack cinder-volume[91227]: INFO cinder.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Initiating service 3 cleanup
Jun 16 18:34:22 devstack cinder-volume[91227]: INFO cinder.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Service 3 cleanup completed.
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.service [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Creating RPC server for service cinder-volume {{(pid=91227) start /opt/stack/cinder/cinder/service.py:231}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.service [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91227) start /opt/stack/cinder/cinder/service.py:237}}
Jun 16 18:34:22 devstack cinder-volume[91227]: INFO cinder.volume.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:22 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:23 devstack sudo[91363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:23 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:23 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:23 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.673s {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:23 devstack cinder-volume[91227]: INFO cinder.volume.manager [None req-1a6e2f58-f7f0-4336-b60e-96f398a58bbd None None] Driver post RPC initialization completed successfully.
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91227) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG cinder.volume.drivers.quobyte [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91227) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91227) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:27 devstack sudo[91479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:27 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:27 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG oslo_concurrency.processutils [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.574s {{(pid=91227) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:27 devstack cinder-volume[91227]: DEBUG cinder.manager [None req-179abef8-2b1e-4d00-b89b-2ca07a09080d None None] Notifying Schedulers of capabilities ... {{(pid=91227) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:34:30 devstack cinder-volume[91035]: DEBUG dbcounter [-] [91035] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91035) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:34:31 devstack cinder-volume[91035]: INFO oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Caught SIGTERM, stopping children
Jun 16 18:34:31 devstack cinder-volume[91035]: DEBUG oslo_concurrency.lockutils [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Acquiring lock "singleton_lock" {{(pid=91035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:34:31 devstack cinder-volume[91035]: DEBUG oslo_concurrency.lockutils [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Acquired lock "singleton_lock" {{(pid=91035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:34:31 devstack cinder-volume[91035]: DEBUG oslo_concurrency.lockutils [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Releasing lock "singleton_lock" {{(pid=91035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:34:31 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Stop services. {{(pid=91035) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 16 18:34:31 devstack cinder-volume[91035]: DEBUG oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Killing children. {{(pid=91035) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 16 18:34:31 devstack cinder-volume[91035]: INFO oslo_service.backend._eventlet.service [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Waiting on 1 children to exit
Jun 16 18:34:32 devstack cinder-volume[91227]: DEBUG dbcounter [-] [91227] Writing DB stats cinder:SELECT=2 {{(pid=91227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:34:33 devstack cinder-volume[91227]: DEBUG dbcounter [-] [91227] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91227) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:34:36 devstack cinder-volume[91227]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 16 18:34:36 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Acquiring lock "singleton_lock" {{(pid=91227) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:34:36 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Acquired lock "singleton_lock" {{(pid=91227) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:34:36 devstack cinder-volume[91227]: DEBUG oslo_concurrency.lockutils [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Releasing lock "singleton_lock" {{(pid=91227) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:34:36 devstack cinder-volume[91227]: WARNING amqp [None req-b9c37297-b6ce-4526-9fdb-db0e01726849 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 16 18:34:38 devstack cinder-volume[91566]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 16 18:34:38 devstack cinder-volume[91566]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 16 18:34:38 devstack cinder-volume[91566]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 16 18:34:39 devstack cinder-volume[91566]: INFO dbcounter [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Registered counter for database cinder
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_db.sqlalchemy.engines [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG dbcounter [-] [91566] Writer thread running {{(pid=91566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 16 18:34:39 devstack cinder-volume[91566]: INFO cinder.rpc [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 16 18:34:39 devstack cinder-volume[91566]: INFO cinder.rpc [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_db.sqlalchemy.engines [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:39 devstack cinder-volume[91566]: INFO cinder.volume.manager [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Determined volume DB was empty at startup.
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG cinder.volume.manager [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91566) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 16 18:34:39 devstack cinder-volume[91566]: WARNING stevedore.named [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 16 18:34:39 devstack cinder-volume[91566]: WARNING castellan.key_manager [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:34:39 devstack cinder-volume[91566]: WARNING cinder.keymgr.conf_key_mgr [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 16 18:34:39 devstack cinder-volume[91566]: INFO cinder.volume.manager [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_db.sqlalchemy.engines [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:39 devstack cinder-volume[91566]: INFO oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Starting 1 workers
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Started child 91851 {{(pid=91566) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Full set of CONF: {{(pid=91566) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] ******************************************************************************** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Configuration options gathered from: {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] ================================================================================ {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] allow_availability_zone_fallback = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] allow_compression_on_image_upload = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] allowed_direct_url_schemes     = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] api_rate_limit                 = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] auth_strategy                  = keystone {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_availability_zone      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_host                   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_name                   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_stats_polling_interval = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backup_api_class               = cinder.backup.api.API {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backup_name_template           = backup-%s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backup_use_same_host           = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91851]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backup_use_temp_snapshot       = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] chap_password                  = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] chap_username                  =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_internal_tenant_project_id = a8f678e9c359415585e6fc7beaad191d {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_internal_tenant_user_id = 90f5cafdb1344ff2b833a00ab22a7091 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cluster                        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] compression_format             = gzip {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] compute_api_class              = cinder.compute.nova.API {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] config_dir                     = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] config_source                  = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] control_exchange               = openstack {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] debug                          = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] default_availability_zone      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] default_group_type             = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] default_volume_type            = QuobyteHD {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] disk_geometry                  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] driver_client_cert             = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] driver_client_cert_key         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] driver_data_namespace          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] driver_ssl_cert_path           = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] driver_ssl_cert_verify         = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] driver_use_ssl                 = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] enable_new_services            = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] enable_unsupported_driver      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] enabled_backends               = ['QuobyteHD'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] enforce_multipath_for_image_xfer = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] filter_function                = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_api_insecure            = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_api_servers             = ['http://192.168.122.236/image'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_api_ssl_compression     = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_ca_certificates_file    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_catalog_info            = image:glance:publicURL {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_certfile                = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_keyfile                 = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_num_retries             = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance_request_timeout         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] goodness_function              = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] graceful_shutdown_timeout      = 5 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] group_api_class                = cinder.group.api.API {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] host                           = devstack {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_compress_on_upload       = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_conversion_address_space_limit = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_conversion_cpu_limit     = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_conversion_disable       = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_upload_use_cinder_backend = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91851) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_upload_use_internal_tenant = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_volume_cache_enabled     = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_volume_cache_max_count   = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] image_volume_cache_max_size_gb = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] init_host_max_objects_retrieval = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] instance_format                = [instance: %(uuid)s]  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] iscsi_target_flags             =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] iscsi_write_cache              = on {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] iser_helper                    = tgtadm {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] iser_ip_address                = 192.168.122.236 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] iser_port                      = 3260 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_color                      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_config_append              = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_dir                        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_file                       = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_options                    = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_rotate_interval            = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_rotate_interval_type       = days {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] log_rotation_type              = none {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] max_age                        = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] max_logfile_count              = 30 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] max_logfile_size_mb            = 200 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] max_over_subscription_ratio    = 20.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] message_reap_interval          = 86400 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] message_ttl                    = 2592000 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] migration_create_volume_timeout_secs = 300 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] monkey_patch                   = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] monkey_patch_modules           = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] my_ip                          = 192.168.122.236 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] no_snapshot_gb_quota           = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] num_iser_scan_tries            = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] num_shell_tries                = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] num_volume_device_scan_tries   = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] nvmeof_conn_info_version       = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] nvmet_ns_id                    = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] nvmet_port_id                  = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_max_limit                = 1000 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_volume_ext_list          = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_volume_listen_port       = 8776 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_volume_use_ssl           = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] osapi_volume_workers           = 2 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] per_volume_size_limit          = -1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] periodic_fuzzy_delay           = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] periodic_interval              = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] public_endpoint                = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] publish_errors                 = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_backup_gigabytes         = 1000 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_backups                  = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_gigabytes                = 1000 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_groups                   = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_snapshots                = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] quota_volumes                  = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] rate_limit_burst               = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] rate_limit_except_level        = CRITICAL {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] rate_limit_interval            = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] reinit_driver_count            = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] replication_device             = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] report_discard_supported       = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] report_interval                = 120 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] reservation_clean_interval     = 86400 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] reservation_expire             = 86400 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] reserved_image_namespaces      = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] reserved_percentage            = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] rpc_response_timeout           = 120 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] run_external_periodic_tasks    = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] scst_target_driver             = iscsi {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] scst_target_iqn_name           = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_down_time              = 720 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] shell_completion               = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] snapshot_name_template         = snapshot-%s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] split_loggers                  = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] state_path                     = /opt/stack/data/cinder {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] storage_availability_zone      = nova {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] storage_protocol               = iSCSI {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] syslog_log_facility            = LOG_USER {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] target_helper                  = lioadm {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] target_ip_address              = 192.168.122.236 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] target_port                    = 3260 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] target_protocol                = iscsi {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] target_secondary_ip_addresses  = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] trace_flags                    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] transport_url                  = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] until_refresh                  = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_chap_auth                  = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_default_quota_class        = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_journal                    = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_json                       = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_multipath_for_image_xfer   = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_stderr                     = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] use_syslog                     = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] verify_glance_signatures       = enabled {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_api_class               = cinder.volume.api.API {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_backend_name            = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_clear                   = zero {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_clear_ionice            = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_clear_size              = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_copy_bps_limit          = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_dd_blocksize            = 1M {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_name_template           = volume-%s {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_service_inithost_offload = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volume_usage_audit_period      = month {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] zoning_mode                    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_concurrency.disable_process_locking = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.admin_password = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.admin_token = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.admin_user  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_port   = 35357 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_protocol = https {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_section = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_type   = password {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_uri    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.auth_version = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.cache       = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.certfile    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.delay_auth_decision = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.http_connect_timeout = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.identity_uri = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.include_service_catalog = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.insecure    = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.interface   = public {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.keyfile     = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_password =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcache_username =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.region_name = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.service_token_roles_required = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.service_type = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.token_cache_time = 300 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.236/identity {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.backend                  = dogpile.cache.null {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.backend_argument         = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.backend_expiration_time  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.config_prefix            = cache.oslo {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.debug_cache_backend      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.enable_retry_client      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.enable_socket_keepalive  = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.enabled                  = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.enforce_fips_mode        = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.expiration_time          = 600 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.hashclient_retry_attempts = 2 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_dead_retry      = 300 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_pool_maxsize    = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_sasl_enabled    = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.password                 = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.proxies                  = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.redis_db                 = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91851) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 16 18:34:39 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 16 18:34:39 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.redis_sentinel_service_name = mymaster {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.redis_server             = localhost:6379 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.retry_attempts           = 2 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Running cmd (subprocess): mount.quobyte {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.retry_delay              = 0.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.socket_keepalive_count   = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.socket_keepalive_idle    = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.socket_keepalive_interval = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.socket_timeout           = 1.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.tls_allowed_ciphers      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.tls_cafile               = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.tls_certfile             = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.tls_enabled              = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.tls_keyfile              = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cache.username                 = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.asyncio_connection    = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.asyncio_slave_connection = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.backend               = sqlalchemy {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.connection            = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.connection_debug      = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.connection_parameters =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.connection_recycle_time = 3600 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.connection_trace      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.db_inc_retry_interval = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.db_max_retries        = 20 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.db_max_retry_interval = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.db_retry_interval     = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.max_overflow          = 50 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.max_pool_size         = 5 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.max_retries           = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.mysql_wsrep_sync_wait = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.pool_timeout          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.retry_interval        = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.slave_connection      = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.sqlite_synchronous    = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.synchronous_reader    = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] database.use_db_reconnect      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.connection_string     = messaging:// {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.enabled               = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.es_doc_type           = notification {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.es_scroll_size        = 10000 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.es_scroll_time        = 2m {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.filter_error_trace    = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.hmac_keys             = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.sentinel_service_name = mymaster {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.socket_timeout        = 0.1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.trace_requests        = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler.trace_sqlalchemy      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler_jaeger.process_tags   = {} {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler_jaeger.service_name_prefix = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] profiler_otlp.service_name_prefix = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.enforce_new_defaults = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: WARNING oslo_config.cfg [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.enforce_scope      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.policy_default_rule = default {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.policy_file        = policy.yaml {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] coordination.backend_url       = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.group          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.helper_command = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] privsep_osbrick.user           = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.group         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.helper_command = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] cinder_sys_admin.user          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.auth_section      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.auth_type         = password {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.cafile            = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.certfile          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.collect_timing    = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.insecure          = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.keyfile           = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.send_service_user_token = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.split_loggers     = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] service_user.timeout           = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.auth_section            = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.auth_type               = password {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.certfile                = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.collect_timing          = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.insecure                = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.keyfile                 = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.region_name             = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.split_loggers           = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] glance.timeout                 = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.backend_availability_zone = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.chap_password = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.chap_username =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.disk_geometry = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.driver_client_cert = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.driver_client_cert_key = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.driver_data_namespace = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.driver_use_ssl = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.enable_unsupported_driver = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.extra_capabilities = {} {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.filter_function = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.goodness_function = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.iscsi_target_flags =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.iscsi_write_cache = on {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.iser_helper   = tgtadm {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.iser_ip_address = 192.168.122.236 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.iser_port     = 3260 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_host      =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_login     = admin {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_mount_options = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_password  = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_private_key =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_share_path =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.num_shell_tries = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.nvmet_port_id = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_client_cfg = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.quobyte_volume_url = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.replication_device = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.report_discard_supported = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.reserved_percentage = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.scst_target_driver = iscsi {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.scst_target_iqn_name = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.storage_protocol = iSCSI {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.target_helper = tgtadm {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.target_ip_address = 192.168.122.236 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.target_port   = 3260 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.target_protocol = iscsi {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.trace_flags   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.unique_fqdn_network = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.use_chap_auth = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_backend_name = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_clear  = zero {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_clear_ionice = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_clear_size = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_reports.file_event_handler = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_reports.log_dir           = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.backend_availability_zone = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.backend_host         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.chap_password        = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.chap_username        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.chiscsi_conf         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.disk_geometry        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.driver_client_cert   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.driver_client_cert_key = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.driver_data_namespace = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.driver_use_ssl       = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.extra_capabilities   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.filter_function      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.goodness_function    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.iser_helper          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.iser_ip_address      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.iser_port            = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.iser_target_prefix   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_host             = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_login            = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:39 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_mount_options    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_password         = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_private_key      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_share_path       = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_ssh_port         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.num_shell_tries      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack quobyte-client[91853]: Reading configuration file: /etc/quobyte/client.cfg
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.nvmet_port_id        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack quobyte-client[91853]: Invalid parameters found, error: missing mount point.
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack quobyte-client[91853]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:40 devstack quobyte-client[91853]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.replication_device   = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.report_discard_supported = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.reserved_percentage  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.scst_target_driver   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.storage_protocol     = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.target_helper        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.target_ip_address    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.target_port          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.target_prefix        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.target_protocol      = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.trace_flags          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.use_chap_auth        = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_clear         = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_clear_size    = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] QuobyteHD.volumes_dir          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.ssl      = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_notifications.driver = [] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_notifications.retry = -1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] oslo_messaging_notifications.transport_url = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] key_manager.fixed_key          = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.barbican_api_version  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.barbican_endpoint     = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.barbican_endpoint_type = public {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.barbican_region_name  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.cafile                = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.certfile              = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.collect_timing        = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.insecure              = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.keyfile               = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.number_of_retries     = 60 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.retry_delay           = 1 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.send_service_user_token = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.split_loggers         = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.timeout               = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.verify_ssl            = True {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican.verify_ssl_path       = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.auth_section = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.auth_type = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.cafile   = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.certfile = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.collect_timing = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.insecure = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.keyfile  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.split_loggers = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] barbican_service_user.timeout  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.approle_role_id          = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.approle_secret_id        = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.kv_mountpoint            = secret {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.kv_path                  = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.kv_version               = 2 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.namespace                = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.root_token_id            = **** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.ssl_ca_crt_file          = None {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.timeout                  = 60.0 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.use_ssl                  = False {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 16 18:34:40 devstack cinder-volume[91566]: DEBUG oslo_service.backend._eventlet.service [None req-5f5b2156-95be-4ed2-afab-a76e49cda54d None None] ******************************************************************************** {{(pid=91566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 16 18:34:40 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.590s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:40 devstack cinder-volume[91851]: INFO cinder.volume.driver [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Driver hasn't implemented _init_vendor_properties()
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.volume.driver [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.722557067871, 'free_capacity_gb': 1775.722557067871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91851) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_db.sqlalchemy.engines [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91851) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writer thread running {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.db.sqlalchemy.api [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Building query based on filter {{(pid=91851) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91851) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:40 devstack cinder-volume[91851]: INFO cinder.keymgr.migration [None req-d8a89d3d-2325-4b62-9831-c25106238d5a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 16 18:34:40 devstack sudo[91883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:40 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:41 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.607s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:34:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Driver initialization completed successfully.
Jun 16 18:34:41 devstack cinder-volume[91851]: INFO cinder.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Initiating service 3 cleanup
Jun 16 18:34:41 devstack cinder-volume[91851]: INFO cinder.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Service 3 cleanup completed.
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG cinder.service [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Creating RPC server for service cinder-volume {{(pid=91851) start /opt/stack/cinder/cinder/service.py:231}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG cinder.service [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91851) start /opt/stack/cinder/cinder/service.py:237}}
Jun 16 18:34:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:34:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:34:41 devstack sudo[91929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:34:41 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:34:42 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root
Jun 16 18:34:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.554s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:34:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ee046f61-b48a-4bc8-9b5e-c2d65d2e8a5a None None] Driver post RPC initialization completed successfully.
Jun 16 18:34:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:34:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 6 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:34:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:34:49 devstack cinder-volume[91566]: DEBUG dbcounter [-] [91566] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:34:50 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:34:52 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:35:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:35:42 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:35:42 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:35:43 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Jun 16 18:35:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.080s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:35:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:35:43 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:35:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 6 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:35:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Flow 'volume_create_manager' (7cf2cacf-d3fb-47ab-b035-bb282ec1d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194b6e27-2221-452d-906e-6b9be99b4130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194b6e27-2221-452d-906e-6b9be99b4130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1842633703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6918fe6d-efcf-4739-8443-eeb548a9d466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b02c33b3884c5eb2b2e97d08f45ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:35:57Z,use_quota=True,user_id='fee7ded19356499b94618bec328e54ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ee0125-5297-4f4c-96bb-5d09ecfd30e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ee0125-5297-4f4c-96bb-5d09ecfd30e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570938d9-2569-480d-9273-12fbed0782e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570938d9-2569-480d-9273-12fbed0782e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6918fe6d-efcf-4739-8443-eeb548a9d466', 'volume_name': 'volume-6918fe6d-efcf-4739-8443-eeb548a9d466', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad5d512-c512-461f-b486-6765199f4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad5d512-c512-461f-b486-6765199f4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8087dfe2-a2b4-4d52-becc-28b4c3a1b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:35:57 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Volume 6918fe6d-efcf-4739-8443-eeb548a9d466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6918fe6d-efcf-4739-8443-eeb548a9d466', 'volume_size': 1}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1842633703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6918fe6d-efcf-4739-8443-eeb548a9d466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b02c33b3884c5eb2b2e97d08f45ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:35:57Z,use_quota=True,user_id='fee7ded19356499b94618bec328e54ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Creating volume 6918fe6d-efcf-4739-8443-eeb548a9d466 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:35:57 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:35:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:35:57 devstack sudo[92465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 1073741824
Jun 16 18:35:57 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:35:59 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root
Jun 16 18:35:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 1073741824" returned: 0 in 1.954s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:35:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:35:59 devstack sudo[92787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466
Jun 16 18:35:59 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:00 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466" returned: 0 in 1.640s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] <== create_volume: return (3744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:36:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.750s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8087dfe2-a2b4-4d52-becc-28b4c3a1b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6918fe6d-efcf-4739-8443-eeb548a9d466', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd80c9c-06e9-4862-9dde-b73735558c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:01 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Volume volume-6918fe6d-efcf-4739-8443-eeb548a9d466 (6918fe6d-efcf-4739-8443-eeb548a9d466): created successfully
Jun 16 18:36:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd80c9c-06e9-4862-9dde-b73735558c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Flow 'volume_create_manager' (7cf2cacf-d3fb-47ab-b035-bb282ec1d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:36:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9953612e-d02b-4848-b5c5-128677766d4e tempest-DeleteServersTestJSON-1094958645 None] Created volume successfully.
Jun 16 18:36:08 devstack cinder-volume[91851]: WARNING py.warnings [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jun 16 18:36:08 devstack cinder-volume[91851]:   .first()
Jun 16 18:36:08 devstack cinder-volume[91851]: 
Jun 16 18:36:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:08 devstack cinder-volume[91851]: INFO oslo.privsep.daemon [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcgiq4tgr/privsep.sock']
Jun 16 18:36:08 devstack sudo[92889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcgiq4tgr/privsep.sock
Jun 16 18:36:08 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Flow 'volume_create_manager' (dc9f3223-509b-42f7-8cb1-b1cec1966ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd44676-4f56-4800-8aa4-d757d901c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd44676-4f56-4800-8aa4-d757d901c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-896417388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616e24a6-7ea7-4259-b22e-9fdce0a9f838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10af64d5fcb54e75bace2e6ef65f8890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:36:09Z,use_quota=True,user_id='fdae16d33617467db8081dfbdff0a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0609d8a2-11f2-467c-9243-21a2b12596df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0609d8a2-11f2-467c-9243-21a2b12596df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33d7847-4d60-4aaa-b7d5-a426e078d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33d7847-4d60-4aaa-b7d5-a426e078d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616e24a6-7ea7-4259-b22e-9fdce0a9f838', 'volume_name': 'volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d192dd41-c9ea-43e2-92af-3d8e94568125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d192dd41-c9ea-43e2-92af-3d8e94568125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0281b440-32dc-41b4-b6f4-c28eb41b787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:09 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Volume 616e24a6-7ea7-4259-b22e-9fdce0a9f838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838', 'volume_size': 1}
Jun 16 18:36:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:11 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:11 devstack cinder-volume[91851]: INFO oslo.privsep.daemon [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Spawned new privsep daemon via rootwrap
Jun 16 18:36:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Accepted privsep connection to /tmp/tmpcgiq4tgr/privsep.sock {{(pid=91851) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Jun 16 18:36:11 devstack cinder-volume[91851]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 16 18:36:11 devstack cinder-volume[91851]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 16 18:36:11 devstack cinder-volume[91851]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 16 18:36:11 devstack cinder-volume[91851]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92926
Jun 16 18:36:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a741b-c542-44dc-aefa-c77e130d6097]: (2,) {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:36:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8117f2b0-e016-4fed-8db1-1d44e9448fba]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:36:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:11 devstack sudo[92928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466
Jun 16 18:36:11 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:12 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466" returned: 0 in 0.933s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.516s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.715s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-896417388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616e24a6-7ea7-4259-b22e-9fdce0a9f838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10af64d5fcb54e75bace2e6ef65f8890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:36:09Z,use_quota=True,user_id='fdae16d33617467db8081dfbdff0a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Creating volume 616e24a6-7ea7-4259-b22e-9fdce0a9f838 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:36:12 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:12 devstack sudo[92934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 1073741824
Jun 16 18:36:12 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-6918fe6d-efcf-4739-8443-eeb548a9d466', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '703be0e8-2486-426f-beeb-4f5e868d4716', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:36:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-ae05a455-2067-4565-a71d-a2505ab92ea2 req-63812f41-2c9c-40d8-ada5-6b1e8a7379e0 tempest-DeleteServersTestJSON-1094958645 None] attachment_update completed successfully.
Jun 16 18:36:13 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 1073741824" returned: 0 in 1.185s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:13 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838
Jun 16 18:36:13 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:14 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838" returned: 0 in 0.791s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0281b440-32dc-41b4-b6f4-c28eb41b787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116353fe-d071-4eb1-97e8-df81e5b3fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:14 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Volume volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 (616e24a6-7ea7-4259-b22e-9fdce0a9f838): created successfully
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116353fe-d071-4eb1-97e8-df81e5b3fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Flow 'volume_create_manager' (dc9f3223-509b-42f7-8cb1-b1cec1966ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:36:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-c6fa9572-de3b-458c-b73f-01d12d1647fa tempest-VolumesAdminNegativeTest-1028030632 None] Created volume successfully.
Jun 16 18:36:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Acquiring lock "cinder-616e24a6-7ea7-4259-b22e-9fdce0a9f838-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:36:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Lock "cinder-616e24a6-7ea7-4259-b22e-9fdce0a9f838-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:36:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Acquiring lock "cinder-quobyte-616e24a6-7ea7-4259-b22e-9fdce0a9f838" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:36:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Lock "cinder-quobyte-616e24a6-7ea7-4259-b22e-9fdce0a9f838" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:36:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cab182-b4f3-4a89-acf1-79bea8f1dde5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:36:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:15 devstack sudo[93356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838
Jun 16 18:36:15 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:16 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838" returned: 0 in 0.810s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:16 devstack sudo[93362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838
Jun 16 18:36:16 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:17 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-616e24a6-7ea7-4259-b22e-9fdce0a9f838" returned: 0 in 1.036s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Lock "cinder-quobyte-616e24a6-7ea7-4259-b22e-9fdce0a9f838" released by "delete_volume" :: held 1.903s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:36:17 devstack cinder-volume[91851]: WARNING cinder.quota [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:36:17 devstack cinder-volume[91851]: WARNING cinder.quota [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:36:17 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Created reservations ['1365cd11-9424-479a-9612-613aafb35643', '4692cba6-0fdf-4a4f-be8c-b6392afa271c', '2026befc-1aee-498e-a5a2-56493f805b79', '6ddb7332-4a5f-4d5f-8217-9d8cdfc87de4'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:36:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:36:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:36:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:18 devstack sudo[93399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:36:18 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:19 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.587s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:19 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:36:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Deleted volume successfully.
Jun 16 18:36:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-60569d7a-2ab9-4110-a492-7efb88121a10 tempest-VolumesAdminNegativeTest-1028030632 None] Lock "cinder-616e24a6-7ea7-4259-b22e-9fdce0a9f838-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:36:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-5e7ee670-d9bb-4137-b119-7aa658bf4e50 req-96b46821-7e3f-4a57-9011-27cdd85feaa0 tempest-DeleteServersTestJSON-1094958645 None] Terminate volume connection completed successfully.
Jun 16 18:36:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-5e7ee670-d9bb-4137-b119-7aa658bf4e50 req-96b46821-7e3f-4a57-9011-27cdd85feaa0 tempest-DeleteServersTestJSON-1094958645 None] Deleting attachment 703be0e8-2486-426f-beeb-4f5e868d4716. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Flow 'volume_create_manager' (b7b517ae-4c14-4965-9021-a9ab39c7d63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5267636e-7d41-4fd6-b5f4-5c79e99dc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5267636e-7d41-4fd6-b5f4-5c79e99dc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1072704512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f60833-8629-4883-a334-9e151e9f9b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc157627e6b4c0e98ecff4bf02691f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:36:25Z,use_quota=True,user_id='b6326d842c164834a33416bacc843b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f61ce76-6aac-41f2-92b9-769f46c3dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f61ce76-6aac-41f2-92b9-769f46c3dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac4ed16-1bc3-4649-9b98-780afe6ab067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac4ed16-1bc3-4649-9b98-780afe6ab067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f60833-8629-4883-a334-9e151e9f9b30', 'volume_name': 'volume-99f60833-8629-4883-a334-9e151e9f9b30', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c48ef0a-e2de-4336-8564-ebafd82589d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c48ef0a-e2de-4336-8564-ebafd82589d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec0ff38-e251-4477-a26f-7bcb03ffd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:25 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Volume 99f60833-8629-4883-a334-9e151e9f9b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f60833-8629-4883-a334-9e151e9f9b30', 'volume_size': 1}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1072704512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f60833-8629-4883-a334-9e151e9f9b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc157627e6b4c0e98ecff4bf02691f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:36:25Z,use_quota=True,user_id='b6326d842c164834a33416bacc843b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Creating volume 99f60833-8629-4883-a334-9e151e9f9b30 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:36:25 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:36:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:25 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 1073741824
Jun 16 18:36:25 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:26 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 1073741824" returned: 0 in 1.113s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:26 devstack sudo[93545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30
Jun 16 18:36:26 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:27 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30" returned: 0 in 0.908s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec0ff38-e251-4477-a26f-7bcb03ffd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f60833-8629-4883-a334-9e151e9f9b30', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ebf331-dab3-444a-bb5e-2fc5d24048a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:36:27 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Volume volume-99f60833-8629-4883-a334-9e151e9f9b30 (99f60833-8629-4883-a334-9e151e9f9b30): created successfully
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ebf331-dab3-444a-bb5e-2fc5d24048a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Flow 'volume_create_manager' (b7b517ae-4c14-4965-9021-a9ab39c7d63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:36:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5c6e0eee-ecbd-4570-b705-c2cd7349a560 tempest-ServerActionsTestOtherA-1102993369 None] Created volume successfully.
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Acquiring lock "cinder-6918fe6d-efcf-4739-8443-eeb548a9d466-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Lock "cinder-6918fe6d-efcf-4739-8443-eeb548a9d466-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Acquiring lock "cinder-quobyte-6918fe6d-efcf-4739-8443-eeb548a9d466" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Lock "cinder-quobyte-6918fe6d-efcf-4739-8443-eeb548a9d466" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ebae5-e1f8-4ecd-acf9-bab0e1945d2b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:36:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:27 devstack sudo[93548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466
Jun 16 18:36:27 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:28 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466" returned: 0 in 1.029s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:28 devstack sudo[93554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466
Jun 16 18:36:28 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:29 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6918fe6d-efcf-4739-8443-eeb548a9d466" returned: 0 in 0.745s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Lock "cinder-quobyte-6918fe6d-efcf-4739-8443-eeb548a9d466" released by "delete_volume" :: held 1.836s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Created reservations ['c25c2684-4977-4796-97f5-e43d939c3752', '90e770c6-db4f-4327-af10-c218356362a2', '96e551b9-5804-4987-8a93-8579a4473ac8', '7a530172-2523-45e9-9473-222b8a7beeac'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:29 devstack sudo[93558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:36:29 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:30 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.852s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:36:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Deleted volume successfully.
Jun 16 18:36:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49eb082f-f82b-4079-90ef-2d54d9c58479 tempest-DeleteServersTestJSON-1094958645 None] Lock "cinder-6918fe6d-efcf-4739-8443-eeb548a9d466-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:36:39 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:DELETE=3,cinder:INSERT=4 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:36:40 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:36:42 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:36:42 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:36:42 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.636s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:36:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:36:52 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:36:52 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Flow 'volume_create_manager' (b8b5a3c1-8f99-4d19-8bfa-939f4f26b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659eb9a1-1622-4f58-be9c-d65d6dbb4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659eb9a1-1622-4f58-be9c-d65d6dbb4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-105705137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d651f5-441c-4af1-9d08-9ce5b2c82ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323794506ff748bc8d81e069b3bed29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:21Z,use_quota=True,user_id='e332544cf4e94a83a705de30b87c94d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c09b15a-a368-4d7b-a68c-144de8794130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c09b15a-a368-4d7b-a68c-144de8794130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c388c8a-4792-4e6b-983b-520c47ed6231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c388c8a-4792-4e6b-983b-520c47ed6231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d651f5-441c-4af1-9d08-9ce5b2c82ae2', 'volume_name': 'volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8965131-0ecc-465a-b5b3-8c30e2686b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8965131-0ecc-465a-b5b3-8c30e2686b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04035d4c-559b-494b-9e59-dc6cb07dde91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:21 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Volume f9d651f5-441c-4af1-9d08-9ce5b2c82ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2', 'volume_size': 1}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-105705137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d651f5-441c-4af1-9d08-9ce5b2c82ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323794506ff748bc8d81e069b3bed29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:21Z,use_quota=True,user_id='e332544cf4e94a83a705de30b87c94d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Creating volume f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:37:21 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:37:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:21 devstack sudo[93958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 1073741824
Jun 16 18:37:21 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:23 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 1073741824" returned: 0 in 1.574s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:23 devstack sudo[94107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2
Jun 16 18:37:23 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:24 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" returned: 0 in 1.565s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] <== create_volume: return (3220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.230s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.345s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04035d4c-559b-494b-9e59-dc6cb07dde91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ceb831d-216e-4d3d-99c8-4861885834e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ade0f3-3ad2-4790-b7d6-3fee2ca7d39e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:37:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:24 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Volume volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 (f9d651f5-441c-4af1-9d08-9ce5b2c82ae2): created successfully
Jun 16 18:37:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ceb831d-216e-4d3d-99c8-4861885834e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Flow 'volume_create_manager' (b8b5a3c1-8f99-4d19-8bfa-939f4f26b00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f940c147-4bfb-4e5e-9738-1896c3eddab2 tempest-TaggedAttachmentsTest-355709960 None] Created volume successfully.
Jun 16 18:37:25 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30
Jun 16 18:37:25 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:26 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30" returned: 0 in 1.493s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.550s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-99f60833-8629-4883-a334-9e151e9f9b30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e98d8174-c9c3-4d94-9c33-c7ce4acb23ad', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:37:26 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-a9e20868-a8cf-42ed-a77a-fe25ac796514 req-90b7d0a8-9904-4b31-a0b2-4343ab2b7e64 tempest-ServerActionsTestOtherA-1102993369 None] attachment_update completed successfully.
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Flow 'volume_create_manager' (c0bf722c-25f7-46fe-a3a4-602e526d9974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668d092f-2e91-4c64-9564-88cf32a6ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668d092f-2e91-4c64-9564-88cf32a6ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846304441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76638c81-7eb0-468f-9f64-604dae678c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029ccb44736340dfb7439ede11a299ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:31Z,use_quota=True,user_id='616ea23bf5b34c068f91d7283ea49e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbc8a62-993d-4704-bbc8-8ae079256a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbc8a62-993d-4704-bbc8-8ae079256a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4d0255-d80a-4ce9-8d29-7afd3c86fed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4d0255-d80a-4ce9-8d29-7afd3c86fed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76638c81-7eb0-468f-9f64-604dae678c15', 'volume_name': 'volume-76638c81-7eb0-468f-9f64-604dae678c15', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2805f-3ddb-4c3b-aa01-7bfc8af4c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2805f-3ddb-4c3b-aa01-7bfc8af4c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6580d648-d293-410d-990e-c95cc8566e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:31 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Volume 76638c81-7eb0-468f-9f64-604dae678c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76638c81-7eb0-468f-9f64-604dae678c15', 'volume_size': 1}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846304441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76638c81-7eb0-468f-9f64-604dae678c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029ccb44736340dfb7439ede11a299ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:31Z,use_quota=True,user_id='616ea23bf5b34c068f91d7283ea49e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Creating volume 76638c81-7eb0-468f-9f64-604dae678c15 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:37:31 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:37:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:31 devstack sudo[94551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15 1073741824
Jun 16 18:37:31 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:32 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15 1073741824" returned: 0 in 1.402s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:33 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15
Jun 16 18:37:33 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:33 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15" returned: 0 in 0.836s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6580d648-d293-410d-990e-c95cc8566e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76638c81-7eb0-468f-9f64-604dae678c15', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a90132-2ae3-4ed5-9147-78e1b909b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:33 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Volume volume-76638c81-7eb0-468f-9f64-604dae678c15 (76638c81-7eb0-468f-9f64-604dae678c15): created successfully
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a90132-2ae3-4ed5-9147-78e1b909b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Flow 'volume_create_manager' (c0bf722c-25f7-46fe-a3a4-602e526d9974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0123f4f1-2f85-483f-85c8-52035e6ac70b tempest-ServersNegativeTestJSON-135800720 None] Created volume successfully.
Jun 16 18:37:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-e59aa347-5281-4445-8dbe-7045d44ca8bd tempest-ServerActionsTestOtherA-1102993369 None] Terminate volume connection completed successfully.
Jun 16 18:37:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-e59aa347-5281-4445-8dbe-7045d44ca8bd tempest-ServerActionsTestOtherA-1102993369 None] Deleting attachment e98d8174-c9c3-4d94-9c33-c7ce4acb23ad. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Flow 'volume_create_manager' (6f3b06b4-81c1-43f7-9267-c9f6153861d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d33cfd0-55e8-4b45-9290-56a7557cca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d33cfd0-55e8-4b45-9290-56a7557cca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1476121068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029ccb44736340dfb7439ede11a299ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:38Z,use_quota=True,user_id='616ea23bf5b34c068f91d7283ea49e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ed9ca-5d19-4c9e-bb62-47061a5e54ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ed9ca-5d19-4c9e-bb62-47061a5e54ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9389f56e-ce13-4dfc-a559-081164e1398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9389f56e-ce13-4dfc-a559-081164e1398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc', 'volume_name': 'volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21eccf27-5749-406d-8dd9-5a5ec1bf26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21eccf27-5749-406d-8dd9-5a5ec1bf26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f769447-9a80-4947-aef7-ac7bf1f47bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Volume 0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc', 'volume_size': 1}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1476121068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029ccb44736340dfb7439ede11a299ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:38Z,use_quota=True,user_id='616ea23bf5b34c068f91d7283ea49e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Creating volume 0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:37:37 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:37:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:37 devstack sudo[94700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc 1073741824
Jun 16 18:37:37 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:40 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc 1073741824" returned: 0 in 2.211s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:40 devstack sudo[94751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc
Jun 16 18:37:40 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:41 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc" returned: 0 in 1.294s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] <== create_volume: return (3640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.643s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.130s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f769447-9a80-4947-aef7-ac7bf1f47bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a78cc6-3b94-472c-9240-4a7ed0afc43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a141a18d-3bf1-4880-b23b-ebcb8392240a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:41 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Volume volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc (0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc): created successfully
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a78cc6-3b94-472c-9240-4a7ed0afc43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Flow 'volume_create_manager' (6f3b06b4-81c1-43f7-9267-c9f6153861d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-68f448d6-e9e0-43af-b43f-67ec50f05e90 tempest-ServersNegativeTestJSON-135800720 None] Created volume successfully.
Jun 16 18:37:41 devstack sudo[94788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30
Jun 16 18:37:41 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 8 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Flow 'volume_create_manager' (a3bb82cf-c96d-4107-a01f-40f8d10134b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d76d99c-c5ce-4801-97d3-4b26d473fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d76d99c-c5ce-4801-97d3-4b26d473fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1402048797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3289a645e6344ff39c255448c2f24b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:42Z,use_quota=True,user_id='1e58c818857c4c80bc5a3a2a5c358025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e135a8e-49d1-421d-ad76-02f31e62f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e135a8e-49d1-421d-ad76-02f31e62f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d78640-a230-4b19-9df1-55c78e376f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d78640-a230-4b19-9df1-55c78e376f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5', 'volume_name': 'volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee9ba88-79af-4253-925b-849eb8d05bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee9ba88-79af-4253-925b-849eb8d05bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb0d1e-b7ed-4dc5-80d3-5523eff98bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Volume 8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5', 'volume_size': 1}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:42 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30" returned: 0 in 1.131s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1402048797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3289a645e6344ff39c255448c2f24b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:37:42Z,use_quota=True,user_id='1e58c818857c4c80bc5a3a2a5c358025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Creating volume 8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:37:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:42 devstack sudo[94794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 1073741824
Jun 16 18:37:42 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-99f60833-8629-4883-a334-9e151e9f9b30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'caf95e1c-5eef-46bc-b528-f7edf62f66b2', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:37:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-6bc69a31-b1d3-43c8-a0eb-eaad360cdcb9 req-3808cedf-6357-4d26-aa67-d4f528dabd6d tempest-ServerActionsTestOtherA-1102993369 None] attachment_update completed successfully.
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "cinder-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "cinder-quobyte-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-quobyte-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc" acquired by "delete_volume" :: waited 0.039s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33795b6-dbef-43ed-a7db-d8450719a92e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:43 devstack sudo[94796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc
Jun 16 18:37:43 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:43 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 1073741824" returned: 0 in 1.078s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:43 devstack sudo[94802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5
Jun 16 18:37:43 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:44 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc" returned: 0 in 1.059s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:44 devstack sudo[94807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc
Jun 16 18:37:44 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:44 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb0d1e-b7ed-4dc5-80d3-5523eff98bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c99d6b7-00c1-4916-994e-23e02b371de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:37:44 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Volume volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 (8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5): created successfully
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c99d6b7-00c1-4916-994e-23e02b371de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:37:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Flow 'volume_create_manager' (a3bb82cf-c96d-4107-a01f-40f8d10134b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:37:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3c829bb9-239f-4340-b852-308e5d314609 tempest-ServerRescueNegativeTestJSON-579100651 None] Created volume successfully.
Jun 16 18:37:45 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-quobyte-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc" released by "delete_volume" :: held 1.887s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Created reservations ['96e7845c-5aa6-4452-886c-b81e442d0eb7', '51a7418c-87f6-4d87-87e7-10fb57842040', '2f5b5d18-19d6-44cc-8ec2-ed1730cc884e', '4e2bc680-0e6c-44f4-b5d6-854b3dc810e5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:45 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:37:45 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "cinder-76638c81-7eb0-468f-9f64-604dae678c15-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-76638c81-7eb0-468f-9f64-604dae678c15-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "cinder-quobyte-76638c81-7eb0-468f-9f64-604dae678c15" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-quobyte-76638c81-7eb0-468f-9f64-604dae678c15" acquired by "delete_volume" :: waited 0.047s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a9373-f301-4dce-803c-e41e346415cb]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:37:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:45 devstack sudo[94833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15
Jun 16 18:37:45 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:46 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.865s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:46 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:37:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Deleted volume successfully.
Jun 16 18:37:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2c6ae64f-441e-49d3-b1bf-96d3b0c3ce95 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-0cf8325a-3b3a-4dd8-bbd6-551cf47d0cfc-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:37:46 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15" returned: 0 in 1.042s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:46 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15
Jun 16 18:37:46 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:48 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-76638c81-7eb0-468f-9f64-604dae678c15" returned: 0 in 1.254s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-quobyte-76638c81-7eb0-468f-9f64-604dae678c15" released by "delete_volume" :: held 2.399s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Created reservations ['2cfbc5b8-8940-4342-be92-b0c2edda3c91', '2a2354d9-a662-40be-9dff-bb630e90f3bd', '3acc2acc-01f9-47f9-a9fe-fd402550eddf', '371b2580-00fa-4e80-a15f-68df9fc8c934'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:37:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:37:48 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:37:48 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:37:50 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Jun 16 18:37:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 2.151s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:37:50 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:37:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Deleted volume successfully.
Jun 16 18:37:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b42326aa-2d29-4b1b-b4ee-45f83b00bbe0 tempest-ServersNegativeTestJSON-135800720 None] Lock "cinder-76638c81-7eb0-468f-9f64-604dae678c15-delete_volume" released by "delete_volume" :: held 5.204s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:37:58 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=38,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:38:00 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=6 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:38:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Acquiring lock "cinder-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "cinder-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Acquiring lock "cinder-quobyte-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "cinder-quobyte-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b82fa-0c5f-4a7e-a80f-7efc9bbdd27b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:09 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5
Jun 16 18:38:09 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:10 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5" returned: 0 in 1.360s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:10 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5
Jun 16 18:38:10 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:11 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5" returned: 0 in 0.810s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "cinder-quobyte-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5" released by "delete_volume" :: held 2.242s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Created reservations ['bac9a2f7-3a26-4ca4-93fd-fd706b5aef94', '6ea1f843-64fa-491c-8e95-4a9c1ac9064f', '455f4a46-a17b-47c5-8ec1-738d18ad31ea', '8b192f4a-cd4f-4ab2-890c-9dd2157fa9e3'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:11 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:11 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:12 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.815s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:12 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Deleted volume successfully.
Jun 16 18:38:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-08154305-01f3-40dc-a077-82fb18aa0018 tempest-ServerRescueNegativeTestJSON-579100651 None] Lock "cinder-8f1de3e8-b20e-4e3a-82cc-1e5f2e674be5-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Flow 'volume_create_manager' (c7b72610-a0b0-45d3-a648-31173834dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bc235c-5d0c-4287-8e6a-6ab9b6f7675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bc235c-5d0c-4287-8e6a-6ab9b6f7675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1036304882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb15e2a8-1d36-4aee-a7ce-9932218a82dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c648beb7c8334fb498d39a0db988f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:13Z,use_quota=True,user_id='29c1705fab084c1e820a5a907844c6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a52730-5130-4243-8a31-c5372c3dbe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a52730-5130-4243-8a31-c5372c3dbe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b747ac-8205-499f-bac8-a1a67ab180ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b747ac-8205-499f-bac8-a1a67ab180ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb15e2a8-1d36-4aee-a7ce-9932218a82dc', 'volume_name': 'volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cfba09-f141-4189-957d-1f3b88e09d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cfba09-f141-4189-957d-1f3b88e09d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e533521-4542-41a6-982c-df6d602b3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:13 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Volume cb15e2a8-1d36-4aee-a7ce-9932218a82dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc', 'volume_size': 1}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1036304882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb15e2a8-1d36-4aee-a7ce-9932218a82dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c648beb7c8334fb498d39a0db988f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:13Z,use_quota=True,user_id='29c1705fab084c1e820a5a907844c6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Creating volume cb15e2a8-1d36-4aee-a7ce-9932218a82dc {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:38:13 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:38:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:13 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc 1073741824
Jun 16 18:38:13 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:14 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc 1073741824" returned: 0 in 1.510s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:14 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc
Jun 16 18:38:14 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:15 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc" returned: 0 in 1.038s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] <== create_volume: return (2621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e533521-4542-41a6-982c-df6d602b3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb92692-d202-4e7e-9d74-43cbc9e40124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:15 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Volume volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc (cb15e2a8-1d36-4aee-a7ce-9932218a82dc): created successfully
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb92692-d202-4e7e-9d74-43cbc9e40124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Flow 'volume_create_manager' (c7b72610-a0b0-45d3-a648-31173834dc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-dec50523-1c92-4195-905d-f07ecb8a979c tempest-VolumesTestJSON-1673944642 None] Created volume successfully.
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Flow 'volume_create_manager' (7b7e82ac-43ad-44c8-ae88-c67949700832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf88435b-3860-47cf-b2a1-0997dc6e3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf88435b-3860-47cf-b2a1-0997dc6e3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-246426984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dc3c82-b65b-4fb4-8b85-7945b72f07ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c648beb7c8334fb498d39a0db988f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:17Z,use_quota=True,user_id='29c1705fab084c1e820a5a907844c6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e4f024-78d6-4e41-aacc-691abb077dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e4f024-78d6-4e41-aacc-691abb077dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99497e9d-3efe-439b-9183-d322ae22c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99497e9d-3efe-439b-9183-d322ae22c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03dc3c82-b65b-4fb4-8b85-7945b72f07ee', 'volume_name': 'volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947b8aa3-1239-47d3-872f-184d36da43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947b8aa3-1239-47d3-872f-184d36da43f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f814abf2-2ed3-4b85-8b2e-e0be07b1237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Volume 03dc3c82-b65b-4fb4-8b85-7945b72f07ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee', 'volume_size': 1}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-246426984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dc3c82-b65b-4fb4-8b85-7945b72f07ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c648beb7c8334fb498d39a0db988f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:17Z,use_quota=True,user_id='29c1705fab084c1e820a5a907844c6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Creating volume 03dc3c82-b65b-4fb4-8b85-7945b72f07ee {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:38:17 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:38:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:17 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee 1073741824
Jun 16 18:38:17 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:18 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee 1073741824" returned: 0 in 1.067s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:18 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee
Jun 16 18:38:18 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:19 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee" returned: 0 in 0.672s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f814abf2-2ed3-4b85-8b2e-e0be07b1237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f0b9c6-ea3d-4002-a014-72efbcc5b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Volume volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee (03dc3c82-b65b-4fb4-8b85-7945b72f07ee): created successfully
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f0b9c6-ea3d-4002-a014-72efbcc5b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Flow 'volume_create_manager' (7b7e82ac-43ad-44c8-ae88-c67949700832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5d42115b-605d-4216-a49a-0a02eac26e50 tempest-VolumesTestJSON-1673944642 None] Created volume successfully.
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Flow 'volume_create_manager' (d8a2a8bf-e187-4012-a6a0-b3763a7f6a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fe7ac8-df50-473f-9060-212ad5d6abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fe7ac8-df50-473f-9060-212ad5d6abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-324003686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b5d869-9003-4843-8ab4-32204a85bd4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c648beb7c8334fb498d39a0db988f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:20Z,use_quota=True,user_id='29c1705fab084c1e820a5a907844c6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d2170b-4157-464a-ba7e-c5066fd87c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d2170b-4157-464a-ba7e-c5066fd87c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f717ed-5821-47b0-9d82-91227458e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f717ed-5821-47b0-9d82-91227458e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b5d869-9003-4843-8ab4-32204a85bd4d', 'volume_name': 'volume-35b5d869-9003-4843-8ab4-32204a85bd4d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d99cafb-9fe6-4f3e-ab9c-1cef66649830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d99cafb-9fe6-4f3e-ab9c-1cef66649830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d6d8bf-eeb3-4fb2-8bd5-74af5f810df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Volume 35b5d869-9003-4843-8ab4-32204a85bd4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b5d869-9003-4843-8ab4-32204a85bd4d', 'volume_size': 1}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-324003686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b5d869-9003-4843-8ab4-32204a85bd4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c648beb7c8334fb498d39a0db988f044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:20Z,use_quota=True,user_id='29c1705fab084c1e820a5a907844c6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Creating volume 35b5d869-9003-4843-8ab4-32204a85bd4d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:38:20 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:38:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:20 devstack sudo[95827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d 1073741824
Jun 16 18:38:20 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:21 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d 1073741824" returned: 0 in 1.110s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:21 devstack sudo[95835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d
Jun 16 18:38:21 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:22 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d" returned: 0 in 1.127s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d6d8bf-eeb3-4fb2-8bd5-74af5f810df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b5d869-9003-4843-8ab4-32204a85bd4d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcf137a-49da-4292-b91d-3f33a100b174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:22 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Volume volume-35b5d869-9003-4843-8ab4-32204a85bd4d (35b5d869-9003-4843-8ab4-32204a85bd4d): created successfully
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcf137a-49da-4292-b91d-3f33a100b174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Flow 'volume_create_manager' (d8a2a8bf-e187-4012-a6a0-b3763a7f6a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ca097086-7d9b-418b-9d14-ed36af5f6c2f tempest-VolumesTestJSON-1673944642 None] Created volume successfully.
Jun 16 18:38:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-2a1d930d-2777-4f7c-a0f4-d679e5875be9 req-f044ab67-bafa-459b-9254-c5db0b4b0a26 tempest-ServerActionsTestOtherA-1102993369 None] Terminate volume connection completed successfully.
Jun 16 18:38:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-2a1d930d-2777-4f7c-a0f4-d679e5875be9 req-f044ab67-bafa-459b-9254-c5db0b4b0a26 tempest-ServerActionsTestOtherA-1102993369 None] Deleting attachment caf95e1c-5eef-46bc-b528-f7edf62f66b2. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:38:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "cinder-35b5d869-9003-4843-8ab4-32204a85bd4d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-35b5d869-9003-4843-8ab4-32204a85bd4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "cinder-quobyte-35b5d869-9003-4843-8ab4-32204a85bd4d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-quobyte-35b5d869-9003-4843-8ab4-32204a85bd4d" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:24 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d866f12-1109-498c-9d8e-e9e9ca4e95fa]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:24 devstack sudo[95920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d
Jun 16 18:38:24 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:25 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:25 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d
Jun 16 18:38:25 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:25 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-35b5d869-9003-4843-8ab4-32204a85bd4d" returned: 0 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-quobyte-35b5d869-9003-4843-8ab4-32204a85bd4d" released by "delete_volume" :: held 1.444s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Created reservations ['e6bcc504-a372-43f8-9733-79de8ae4074a', '8acc89b0-c4d4-4c65-b1ac-6835ea2ba90b', 'baa34b3c-6bf7-498c-a2a0-ecc7173577b8', 'a883dba1-ca78-46cb-ad76-dd2a53da4516'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:26 devstack sudo[95931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:26 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "cinder-03dc3c82-b65b-4fb4-8b85-7945b72f07ee-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-03dc3c82-b65b-4fb4-8b85-7945b72f07ee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "cinder-quobyte-03dc3c82-b65b-4fb4-8b85-7945b72f07ee" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-quobyte-03dc3c82-b65b-4fb4-8b85-7945b72f07ee" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[872faadf-bdc2-4739-9626-de4f5b11fe11]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:27 devstack sudo[96000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee
Jun 16 18:38:27 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:27 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.169s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:27 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Deleted volume successfully.
Jun 16 18:38:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a15df6c-ebb8-432d-8ec9-d89fc9ee9de0 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-35b5d869-9003-4843-8ab4-32204a85bd4d-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:27 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee" returned: 0 in 0.974s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:27 devstack sudo[96018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee
Jun 16 18:38:27 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:28 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-03dc3c82-b65b-4fb4-8b85-7945b72f07ee" returned: 0 in 0.665s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-quobyte-03dc3c82-b65b-4fb4-8b85-7945b72f07ee" released by "delete_volume" :: held 1.727s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Created reservations ['bd8cf290-f193-4c84-bc2c-4df3ca7ffbb4', '377edc59-fd63-4177-9307-46998778d671', '8c8edfe9-55d5-4b77-83ce-3ec3dfbd4c8d', '1483fa0f-1479-43b5-95e2-969b184dd524'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:28 devstack sudo[96023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:28 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "cinder-cb15e2a8-1d36-4aee-a7ce-9932218a82dc-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-cb15e2a8-1d36-4aee-a7ce-9932218a82dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "cinder-quobyte-cb15e2a8-1d36-4aee-a7ce-9932218a82dc" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-quobyte-cb15e2a8-1d36-4aee-a7ce-9932218a82dc" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b22da-3270-46c3-b87a-8dc02a12dd7d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:29 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc
Jun 16 18:38:29 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:29 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.673s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Deleted volume successfully.
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-90cf56d0-c083-435b-ae6a-68a0c28cf419 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-03dc3c82-b65b-4fb4-8b85-7945b72f07ee-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:29 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc" returned: 0 in 0.863s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:29 devstack sudo[96032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc
Jun 16 18:38:29 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:30 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cb15e2a8-1d36-4aee-a7ce-9932218a82dc" returned: 0 in 0.653s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-quobyte-cb15e2a8-1d36-4aee-a7ce-9932218a82dc" released by "delete_volume" :: held 1.575s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Created reservations ['d4e2eeec-e43b-4dc7-869c-df7312ab91fa', '1c2b5fc9-fb8c-4636-af10-f4d09516ea94', 'eee48464-ccf5-4015-9716-f5a19e10738e', '54139239-b773-4dcc-b02a-d7322e1cb6f5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:30 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:30 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:31 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.631s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:31 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Deleted volume successfully.
Jun 16 18:38:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bc9e7600-3b99-48fa-b303-b68dacc7be42 tempest-VolumesTestJSON-1673944642 None] Lock "cinder-cb15e2a8-1d36-4aee-a7ce-9932218a82dc-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[81218913-808a-4668-b5f9-8c85a505a219]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:33 devstack sudo[96048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2
Jun 16 18:38:33 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:34 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" returned: 0 in 0.942s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f30fde54-aeff-4376-83d2-538a294647c5', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "cinder-99f60833-8629-4883-a334-9e151e9f9b30-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Lock "cinder-99f60833-8629-4883-a334-9e151e9f9b30-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-fce3c5f3-0d16-4acc-a6d0-c7c161039917 req-e1670ae4-847c-4062-bfb1-5d738fac669d tempest-TaggedAttachmentsTest-355709960 None] attachment_update completed successfully.
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "cinder-quobyte-99f60833-8629-4883-a334-9e151e9f9b30" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Lock "cinder-quobyte-99f60833-8629-4883-a334-9e151e9f9b30" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56e5c4-074e-4d4f-9dae-566ffb8f17df]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:34 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30
Jun 16 18:38:34 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:35 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30" returned: 0 in 0.818s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:35 devstack sudo[96128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30
Jun 16 18:38:35 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:36 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-99f60833-8629-4883-a334-9e151e9f9b30" returned: 0 in 0.728s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Lock "cinder-quobyte-99f60833-8629-4883-a334-9e151e9f9b30" released by "delete_volume" :: held 1.598s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Created reservations ['9692b486-18e3-40db-baf1-987ac257ed90', '9b2a8e68-9141-47de-91fc-bef6e0aa519f', '476603d5-e719-4e4f-b16b-6a0d2b29611d', '4658a15c-10a6-47ac-a58c-4d65b36bce68'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:36 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:36 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-db66aae6-a9e7-476e-8f82-93aece89f269 tempest-GroupSnapshotsV319Test-1039427920 None] Group tempest-GroupSnapshotsV319Test-Group-1691067574: creating
Jun 16 18:38:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-db66aae6-a9e7-476e-8f82-93aece89f269 tempest-GroupSnapshotsV319Test-1039427920 None] Group tempest-GroupSnapshotsV319Test-Group-1691067574: created successfully
Jun 16 18:38:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-db66aae6-a9e7-476e-8f82-93aece89f269 tempest-GroupSnapshotsV319Test-1039427920 None] Create group completed successfully.
Jun 16 18:38:37 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.783s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:37 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Deleted volume successfully.
Jun 16 18:38:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bdd1d64d-306c-464d-9d73-b129af4f1d61 tempest-ServerActionsTestOtherA-1102993369 None] Lock "cinder-99f60833-8629-4883-a334-9e151e9f9b30-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:38 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:38:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Flow 'volume_create_manager' (b45b58a9-2e6e-4e29-a6bb-0570b543717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2cf034-b842-4db0-9760-6256e8a8a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2cf034-b842-4db0-9760-6256e8a8a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1031107974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=566582a8-51a5-4ce2-8441-3ef49df745dc,host='devstack@QuobyteHD#QuobyteHD',id=d743d2b3-2d43-4387-a8b5-15efa18f2854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cef62dbb4041439a26c9d448419c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:39Z,use_quota=True,user_id='952fb4e7da604fd585cdbef22f42a471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a753939-d5b3-4861-b782-4146e7b01001),volume_type_id=0a753939-d5b3-4861-b782-4146e7b01001)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390c146b-d39f-4507-9bd1-c5909002de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390c146b-d39f-4507-9bd1-c5909002de7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1eee91c-765f-46e3-9184-41b86647a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1eee91c-765f-46e3-9184-41b86647a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd743d2b3-2d43-4387-a8b5-15efa18f2854', 'volume_name': 'volume-d743d2b3-2d43-4387-a8b5-15efa18f2854', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464c5713-0691-4fb7-8c2a-311f61625531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464c5713-0691-4fb7-8c2a-311f61625531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbda931-df29-497b-8bbb-772149cd192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Volume d743d2b3-2d43-4387-a8b5-15efa18f2854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d743d2b3-2d43-4387-a8b5-15efa18f2854', 'volume_size': 1}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=566582a8-51a5-4ce2-8441-3ef49df745dc,created_at=2026-06-16T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1031107974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=566582a8-51a5-4ce2-8441-3ef49df745dc,host='devstack@QuobyteHD#QuobyteHD',id=d743d2b3-2d43-4387-a8b5-15efa18f2854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cef62dbb4041439a26c9d448419c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:39Z,use_quota=True,user_id='952fb4e7da604fd585cdbef22f42a471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a753939-d5b3-4861-b782-4146e7b01001),volume_type_id=0a753939-d5b3-4861-b782-4146e7b01001)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Creating volume d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:38:39 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:38:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:39 devstack sudo[96487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 1073741824
Jun 16 18:38:39 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:40 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 1073741824" returned: 0 in 0.953s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:40 devstack sudo[96498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854
Jun 16 18:38:40 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:40 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854" returned: 0 in 0.756s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbda931-df29-497b-8bbb-772149cd192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d743d2b3-2d43-4387-a8b5-15efa18f2854', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728ca546-0606-4485-b17b-a7a1b8081bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:40 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Volume volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 (d743d2b3-2d43-4387-a8b5-15efa18f2854): created successfully
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728ca546-0606-4485-b17b-a7a1b8081bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Flow 'volume_create_manager' (b45b58a9-2e6e-4e29-a6bb-0570b543717e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:40 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9c1e7623-b865-4d0a-8f7c-cf5872c628b3 tempest-GroupSnapshotsV319Test-1039427920 None] Created volume successfully.
Jun 16 18:38:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] GroupSnapshot 8cf55968-4a5e-41fa-b73f-c016b41a1a92: creating.
Jun 16 18:38:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Group snapshot 8cf55968-4a5e-41fa-b73f-c016b41a1a92: creating. {{(pid=91851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 16 18:38:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Creating offline snapshot d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 of volume d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:38:41 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f03ec5d-f443-4e2e-a8d7-377444844d96]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:41 devstack sudo[96503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854
Jun 16 18:38:41 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:42 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:42 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:42 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854" returned: 0 in 1.111s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:42 devstack sudo[96537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 1G
Jun 16 18:38:42 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-c2e19fa0-48b1-4cd2-a4a5-875efca4e78b req-621dfc52-85a8-400a-bfa6-0571e1adbe55 tempest-TaggedAttachmentsTest-355709960 None] Terminate volume connection completed successfully.
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-c2e19fa0-48b1-4cd2-a4a5-875efca4e78b req-621dfc52-85a8-400a-bfa6-0571e1adbe55 tempest-TaggedAttachmentsTest-355709960 None] Deleting attachment f30fde54-aeff-4376-83d2-538a294647c5. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:38:42 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.864s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 8 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:38:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:38:43 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 1G" returned: 0 in 1.071s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:43 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3
Jun 16 18:38:43 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:44 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" returned: 0 in 0.874s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:44 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:38:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:44 devstack sudo[96549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3
Jun 16 18:38:44 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:45 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" returned: 0 in 0.922s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:45 devstack sudo[96573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info
Jun 16 18:38:45 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:46 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info" returned: 0 in 0.694s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:46 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:38:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:46 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info
Jun 16 18:38:46 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:47 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.info" returned: 0 in 0.750s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.554s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:47 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-314b197a-857c-4df0-99d7-af999735c541 tempest-GroupSnapshotsV319Test-1039427920 None] group_snapshot 8cf55968-4a5e-41fa-b73f-c016b41a1a92: created successfully
Jun 16 18:38:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] group_snapshot 8cf55968-4a5e-41fa-b73f-c016b41a1a92: deleting
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] group_snapshot 8cf55968-4a5e-41fa-b73f-c016b41a1a92: deleting {{(pid=91851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "cinder-quobyte-d743d2b3-2d43-4387-a8b5-15efa18f2854" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Lock "cinder-quobyte-d743d2b3-2d43-4387-a8b5-15efa18f2854" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "cinder-quobyte-d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Lock "cinder-quobyte-d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Deleting offline snapshot d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 of volume d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] snapshot_file for this snap is: volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139748a-2c2e-4578-9281-5ef296a23c96]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:48 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3
Jun 16 18:38:48 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:49 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" returned: 0 in 0.895s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d743d2b3-2d43-4387-a8b5-15efa18f2854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:38:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf222d8-f4bd-4542-a2b1-42f7f8603b19]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:49 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854
Jun 16 18:38:49 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:50 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854" returned: 0 in 0.835s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:50 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3
Jun 16 18:38:50 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:51 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" returned: 0 in 0.769s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:51 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3
Jun 16 18:38:51 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:51 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854.d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" returned: 0 in 0.732s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Lock "cinder-quobyte-d673f0e7-b33a-42cf-ac31-e0a7bcd4f2f3" released by "_delete_snapshot" :: held 3.369s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Lock "cinder-quobyte-d743d2b3-2d43-4387-a8b5-15efa18f2854" released by "delete_snapshot" :: held 3.407s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:51 devstack cinder-volume[91851]: WARNING cinder.quota [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-974245786 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-974245786, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:38:51 devstack cinder-volume[91851]: WARNING cinder.quota [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-974245786 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-974245786, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:38:51 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] Created reservations ['edf55712-c447-48f2-bb82-6b48d1e09343', 'c5d54fba-661c-4408-ac98-157d9cf8ee50', 'bcda28f2-9c79-4010-a89d-d4ae24acda74', 'b8133cd5-d45b-48d7-a0b3-94d8f4064f71'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:52 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-258b821c-0058-48e4-835c-7de34150766e tempest-GroupSnapshotsV319Test-1039427920 None] group_snapshot 8cf55968-4a5e-41fa-b73f-c016b41a1a92: deleted successfully
Jun 16 18:38:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "cinder-quobyte-d743d2b3-2d43-4387-a8b5-15efa18f2854" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "cinder-quobyte-d743d2b3-2d43-4387-a8b5-15efa18f2854" acquired by "delete_volume" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:53 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e289186-5747-4e82-9b43-0811af6e43fd]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:53 devstack sudo[96607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854
Jun 16 18:38:53 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:54 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854" returned: 0 in 0.954s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:54 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854
Jun 16 18:38:54 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:54 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d743d2b3-2d43-4387-a8b5-15efa18f2854" returned: 0 in 0.702s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "cinder-quobyte-d743d2b3-2d43-4387-a8b5-15efa18f2854" released by "delete_volume" :: held 1.752s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Created reservations ['77325425-15dc-4ed5-8f2f-534bff0a66a9'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:55 devstack cinder-volume[91851]: WARNING cinder.quota [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-974245786 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-974245786, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Created reservations ['d1104240-a8cf-4324-881d-c630e96aa081', 'ab3c1d3f-7967-453a-b33a-d2a9e0aa448a', '3f665c55-6caf-4d45-90d7-95ed93e8b1fa', '810ac36d-50aa-4e5e-87d4-89800c45babc'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:55 devstack sudo[96655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:38:55 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:56 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.920s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:38:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-daf22b05-8835-4e6e-8592-d761ddd5da25 tempest-GroupSnapshotsV319Test-1039427920 None] Delete group completed successfully.
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Flow 'volume_create_manager' (546d9fc0-3c7a-42ca-acfa-dd6c16e3a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b1ccc9-f81e-4d90-a1ee-a837ac628be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b1ccc9-f81e-4d90-a1ee-a837ac628be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1038219557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d259f5a4-cf95-4082-a49e-2e126aef1524,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b23d7bafc821412b8200e0ec3a5f5cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:56Z,use_quota=True,user_id='0e05def78bd14bac97a22c95ae62e8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f41f819-d027-4d37-856c-1b835b3194ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f41f819-d027-4d37-856c-1b835b3194ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce34a783-0cf1-409a-a9cc-6b8b64131ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce34a783-0cf1-409a-a9cc-6b8b64131ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd259f5a4-cf95-4082-a49e-2e126aef1524', 'volume_name': 'volume-d259f5a4-cf95-4082-a49e-2e126aef1524', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff6da70-2204-400e-a52c-cea9f7a577eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff6da70-2204-400e-a52c-cea9f7a577eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510ec0ca-64c3-4a5f-be19-a843b92c8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Volume d259f5a4-cf95-4082-a49e-2e126aef1524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d259f5a4-cf95-4082-a49e-2e126aef1524', 'volume_size': 1}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1038219557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d259f5a4-cf95-4082-a49e-2e126aef1524,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b23d7bafc821412b8200e0ec3a5f5cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:38:56Z,use_quota=True,user_id='0e05def78bd14bac97a22c95ae62e8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Creating volume d259f5a4-cf95-4082-a49e-2e126aef1524 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:38:56 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:38:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:56 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524 1073741824
Jun 16 18:38:56 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:57 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524 1073741824" returned: 0 in 1.133s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:57 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524
Jun 16 18:38:57 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:38:58 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524" returned: 0 in 0.710s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510ec0ca-64c3-4a5f-be19-a843b92c8608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d259f5a4-cf95-4082-a49e-2e126aef1524', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6203f69a-8821-4d15-894d-e6d4653e6108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:38:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Volume volume-d259f5a4-cf95-4082-a49e-2e126aef1524 (d259f5a4-cf95-4082-a49e-2e126aef1524): created successfully
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6203f69a-8821-4d15-894d-e6d4653e6108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:38:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Flow 'volume_create_manager' (546d9fc0-3c7a-42ca-acfa-dd6c16e3a562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:38:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-be4028b3-58cb-4b95-bf54-2b193aae783b req-7826dfb7-1431-407d-a96e-ca81a2e3d433 tempest-VolumesGetTestJSON-1974820350 None] Created volume successfully.
Jun 16 18:38:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Acquiring lock "cinder-d259f5a4-cf95-4082-a49e-2e126aef1524-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Lock "cinder-d259f5a4-cf95-4082-a49e-2e126aef1524-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Acquiring lock "cinder-quobyte-d259f5a4-cf95-4082-a49e-2e126aef1524" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:38:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Lock "cinder-quobyte-d259f5a4-cf95-4082-a49e-2e126aef1524" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:38:59 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[17762d03-34be-49f0-8f6d-4f013f5f7a9d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:38:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:38:59 devstack sudo[96689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524
Jun 16 18:38:59 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:00 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524" returned: 0 in 0.789s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:00 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524
Jun 16 18:39:00 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:01 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d259f5a4-cf95-4082-a49e-2e126aef1524" returned: 0 in 0.625s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Lock "cinder-quobyte-d259f5a4-cf95-4082-a49e-2e126aef1524" released by "delete_volume" :: held 1.464s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=76,cinder:UPDATE=73,cinder:INSERT=22,cinder:DELETE=3 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG cinder.quota [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Created reservations ['c3a4a2f5-e564-4ca2-a459-fffcd8e70762', 'aecddbef-5b50-49b5-9a91-c0eadfa9a6af', '39dfa47f-8c80-4a55-a89a-476b5453e04f', 'd2b2db8c-b609-4787-b8b9-813f8aabd0d2'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:01 devstack sudo[96697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:01 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3cda1238-6cd7-4747-8acd-51742657eda1 tempest-GroupsTest-386541257 None] Group tempest-Group1-952491992: creating
Jun 16 18:39:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3cda1238-6cd7-4747-8acd-51742657eda1 tempest-GroupsTest-386541257 None] Group tempest-Group1-952491992: created successfully
Jun 16 18:39:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3cda1238-6cd7-4747-8acd-51742657eda1 tempest-GroupsTest-386541257 None] Create group completed successfully.
Jun 16 18:39:02 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:02 devstack cinder-volume[91851]: DEBUG cinder.manager [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:02 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Deleted volume successfully.
Jun 16 18:39:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-e7084e21-61e0-4634-8765-5f84b22c46ac req-da77fc3a-b34e-494c-a7a9-2eb805e85983 tempest-VolumesGetTestJSON-1974820350 None] Lock "cinder-d259f5a4-cf95-4082-a49e-2e126aef1524-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1331bf8e-5aec-4e45-b79d-662df46dd80f tempest-GroupsTest-386541257 None] Group tempest-Group2-1348806419: creating
Jun 16 18:39:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1331bf8e-5aec-4e45-b79d-662df46dd80f tempest-GroupsTest-386541257 None] Group tempest-Group2-1348806419: created successfully
Jun 16 18:39:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1331bf8e-5aec-4e45-b79d-662df46dd80f tempest-GroupsTest-386541257 None] Create group completed successfully.
Jun 16 18:39:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Acquiring lock "cinder-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Lock "cinder-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Acquiring lock "cinder-quobyte-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Lock "cinder-quobyte-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[657692cf-5016-4b83-b072-089a2d362b63]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:03 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2
Jun 16 18:39:03 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:04 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" returned: 0 in 0.960s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:04 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2
Jun 16 18:39:04 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Flow 'volume_create_manager' (767cd70f-b687-40b0-bf5d-115664ea8f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8164c5-e120-46d7-a399-7c397008b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8164c5-e120-46d7-a399-7c397008b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1082846250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=be357436-bbde-4a12-9045-3b2ce895dae1,host='devstack@QuobyteHD#QuobyteHD',id=4468a52f-d337-46d1-bcb6-6a7348c7faa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972460ea8a5b444785b026d80a0abe1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:05Z,use_quota=True,user_id='a0bcdfbed34b4291b7cdaba085839a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(558da997-a9ff-4fa4-a087-02bb4828a7c5),volume_type_id=558da997-a9ff-4fa4-a087-02bb4828a7c5)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba2de14-6977-4a6e-856b-1c51e00d4f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba2de14-6977-4a6e-856b-1c51e00d4f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e955b7-8598-4667-8d13-b9d827eabfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e955b7-8598-4667-8d13-b9d827eabfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4468a52f-d337-46d1-bcb6-6a7348c7faa7', 'volume_name': 'volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76224ab0-76fd-43f7-adf1-4bd94e9372c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76224ab0-76fd-43f7-adf1-4bd94e9372c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab51395-5cf9-4ced-9418-237f77fba670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:05 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Volume 4468a52f-d337-46d1-bcb6-6a7348c7faa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7', 'volume_size': 1}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=be357436-bbde-4a12-9045-3b2ce895dae1,created_at=2026-06-16T16:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1082846250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=be357436-bbde-4a12-9045-3b2ce895dae1,host='devstack@QuobyteHD#QuobyteHD',id=4468a52f-d337-46d1-bcb6-6a7348c7faa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972460ea8a5b444785b026d80a0abe1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:05Z,use_quota=True,user_id='a0bcdfbed34b4291b7cdaba085839a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(558da997-a9ff-4fa4-a087-02bb4828a7c5),volume_type_id=558da997-a9ff-4fa4-a087-02bb4828a7c5)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Creating volume 4468a52f-d337-46d1-bcb6-6a7348c7faa7 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:05 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:05 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 1073741824
Jun 16 18:39:05 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:05 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" returned: 0 in 1.119s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Lock "cinder-quobyte-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2" released by "delete_volume" :: held 2.146s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Created reservations ['fd31d8ad-8491-4dcc-b9ee-1a42ed0ec652', 'be4de4e5-cc06-42c3-8a5c-9beba3e58735', '25d25312-72fc-4858-bde9-a53d65220912', '525b8575-1732-435e-a4cb-cd0ba900f8d6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:05 devstack sudo[96777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:05 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:06 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 1073741824" returned: 0 in 1.289s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:06 devstack sudo[96783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7
Jun 16 18:39:06 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:07 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.177s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:07 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:07 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Deleted volume successfully.
Jun 16 18:39:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a81a5f02-27b7-4297-aa3e-88ef408069ad tempest-TaggedAttachmentsTest-355709960 None] Lock "cinder-f9d651f5-441c-4af1-9d08-9ce5b2c82ae2-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:07 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7" returned: 0 in 1.045s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab51395-5cf9-4ced-9418-237f77fba670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6e08c-294a-40d1-a274-efe7c35a1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Volume volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 (4468a52f-d337-46d1-bcb6-6a7348c7faa7): created successfully
Jun 16 18:39:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6e08c-294a-40d1-a274-efe7c35a1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Flow 'volume_create_manager' (767cd70f-b687-40b0-bf5d-115664ea8f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:08 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6351f1f1-a525-4b4b-be37-f0130a8c26e5 tempest-GroupsTest-386541257 None] Created volume successfully.
Jun 16 18:39:09 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=78,cinder:INSERT=20,cinder:UPDATE=100,cinder:DELETE=9 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:39:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Acquiring lock "cinder-quobyte-4468a52f-d337-46d1-bcb6-6a7348c7faa7" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Lock "cinder-quobyte-4468a52f-d337-46d1-bcb6-6a7348c7faa7" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:10 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b318539e-5d46-436a-9404-1b07e6db9725]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:10 devstack sudo[96791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7
Jun 16 18:39:10 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:11 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7" returned: 0 in 1.255s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:11 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7
Jun 16 18:39:11 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:12 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4468a52f-d337-46d1-bcb6-6a7348c7faa7" returned: 0 in 0.942s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Lock "cinder-quobyte-4468a52f-d337-46d1-bcb6-6a7348c7faa7" released by "delete_volume" :: held 2.281s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Created reservations ['0dabda00-6104-4bf3-b4d5-4c3401905f5b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:12 devstack cinder-volume[91851]: WARNING cinder.quota [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1655223542 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1655223542, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:39:12 devstack cinder-volume[91851]: WARNING cinder.quota [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1655223542 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1655223542, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Created reservations ['7da55756-2223-4a23-862a-5382c2dc8917', 'f065d0ef-ba09-454b-baa7-ee00e26cf5cd', '65db3587-d9a9-475d-9c97-2877151ba5a4', '33de4bba-2785-46c4-951d-c7e5ccaee8d3'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:12 devstack sudo[96801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:12 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:13 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.836s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:13 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-57a8760d-32eb-469a-a641-fe982fac2185 tempest-GroupsTest-386541257 None] Delete group completed successfully.
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Created reservations ['4842f530-9584-4b48-b324-fbce66ac5bb1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:13 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:13 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:14 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.807s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:14 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-669756c0-9454-4b39-a62a-c46a5d0e174f tempest-GroupsTest-386541257 None] Delete group completed successfully.
Jun 16 18:39:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d2f624bd-2151-4001-8269-39f2eab405a9 tempest-GroupsTest-386541257 None] Group tempest-GroupsTest-Group-2033257457: creating
Jun 16 18:39:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d2f624bd-2151-4001-8269-39f2eab405a9 tempest-GroupsTest-386541257 None] Group tempest-GroupsTest-Group-2033257457: created successfully
Jun 16 18:39:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d2f624bd-2151-4001-8269-39f2eab405a9 tempest-GroupsTest-386541257 None] Create group completed successfully.
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Flow 'volume_create_manager' (ecd4b1cf-ee03-4e53-8ad9-2e9d0bd7ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89660345-f5a0-40fc-8053-9bbb57491fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89660345-f5a0-40fc-8053-9bbb57491fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1647503415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=410e9b3d-6bd1-413c-ba7c-658555437028,host='devstack@QuobyteHD#QuobyteHD',id=fc8434af-b2f3-478c-aada-be74986af879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972460ea8a5b444785b026d80a0abe1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:17Z,use_quota=True,user_id='a0bcdfbed34b4291b7cdaba085839a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c8b483-931e-4c8e-9153-d4c380d61fb0),volume_type_id=03c8b483-931e-4c8e-9153-d4c380d61fb0)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73077b5-8849-4be4-ab9d-5c35a068d2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73077b5-8849-4be4-ab9d-5c35a068d2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c229efbd-e683-485e-80f3-5bfd95e31105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c229efbd-e683-485e-80f3-5bfd95e31105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8434af-b2f3-478c-aada-be74986af879', 'volume_name': 'volume-fc8434af-b2f3-478c-aada-be74986af879', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e733d6ff-0138-4322-a662-73f8f96f2a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e733d6ff-0138-4322-a662-73f8f96f2a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dc2004-29b7-46ef-9da9-c90fdb817758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Volume fc8434af-b2f3-478c-aada-be74986af879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8434af-b2f3-478c-aada-be74986af879', 'volume_size': 1}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=410e9b3d-6bd1-413c-ba7c-658555437028,created_at=2026-06-16T16:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1647503415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=410e9b3d-6bd1-413c-ba7c-658555437028,host='devstack@QuobyteHD#QuobyteHD',id=fc8434af-b2f3-478c-aada-be74986af879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972460ea8a5b444785b026d80a0abe1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:17Z,use_quota=True,user_id='a0bcdfbed34b4291b7cdaba085839a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c8b483-931e-4c8e-9153-d4c380d61fb0),volume_type_id=03c8b483-931e-4c8e-9153-d4c380d61fb0)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Creating volume fc8434af-b2f3-478c-aada-be74986af879 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:17 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:17 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879 1073741824
Jun 16 18:39:17 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:18 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879 1073741824" returned: 0 in 0.948s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:18 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879
Jun 16 18:39:18 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:19 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879" returned: 0 in 0.665s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dc2004-29b7-46ef-9da9-c90fdb817758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8434af-b2f3-478c-aada-be74986af879', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e569dc-6100-4967-838f-5d390989215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Volume volume-fc8434af-b2f3-478c-aada-be74986af879 (fc8434af-b2f3-478c-aada-be74986af879): created successfully
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e569dc-6100-4967-838f-5d390989215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Flow 'volume_create_manager' (ecd4b1cf-ee03-4e53-8ad9-2e9d0bd7ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3e292837-8e5c-40af-b1b1-f75f59f53a0f tempest-GroupsTest-386541257 None] Created volume successfully.
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Flow 'volume_create_manager' (27ee33d4-33ed-4118-87e3-73c221654a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51629a0d-e7ed-4ab4-9cca-9675864dbbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51629a0d-e7ed-4ab4-9cca-9675864dbbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1040519326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=410e9b3d-6bd1-413c-ba7c-658555437028,host='devstack@QuobyteHD#QuobyteHD',id=c3b2cd3c-ee9b-403a-98ed-ec0825c88af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972460ea8a5b444785b026d80a0abe1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:20Z,use_quota=True,user_id='a0bcdfbed34b4291b7cdaba085839a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c8b483-931e-4c8e-9153-d4c380d61fb0),volume_type_id=03c8b483-931e-4c8e-9153-d4c380d61fb0)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f760df7-45a0-4736-a39f-9d3981a6a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f760df7-45a0-4736-a39f-9d3981a6a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f49e19-09ac-4e69-b9bb-6791b48acc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f49e19-09ac-4e69-b9bb-6791b48acc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b2cd3c-ee9b-403a-98ed-ec0825c88af8', 'volume_name': 'volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c074946c-d7f0-4fd5-8122-1d4a5588e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c074946c-d7f0-4fd5-8122-1d4a5588e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611beeee-eb39-48dd-a1ce-b55d5d3bf5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Volume c3b2cd3c-ee9b-403a-98ed-ec0825c88af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8', 'volume_size': 1}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=410e9b3d-6bd1-413c-ba7c-658555437028,created_at=2026-06-16T16:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1040519326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=410e9b3d-6bd1-413c-ba7c-658555437028,host='devstack@QuobyteHD#QuobyteHD',id=c3b2cd3c-ee9b-403a-98ed-ec0825c88af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972460ea8a5b444785b026d80a0abe1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:20Z,use_quota=True,user_id='a0bcdfbed34b4291b7cdaba085839a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c8b483-931e-4c8e-9153-d4c380d61fb0),volume_type_id=03c8b483-931e-4c8e-9153-d4c380d61fb0)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Creating volume c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:19 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:19 devstack sudo[96841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 1073741824
Jun 16 18:39:19 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:20 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 1073741824" returned: 0 in 0.778s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:20 devstack sudo[96847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8
Jun 16 18:39:20 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:21 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8" returned: 0 in 0.709s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611beeee-eb39-48dd-a1ce-b55d5d3bf5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc526a51-38ad-4245-8b14-3db782d69b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:21 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Volume volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 (c3b2cd3c-ee9b-403a-98ed-ec0825c88af8): created successfully
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc526a51-38ad-4245-8b14-3db782d69b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Flow 'volume_create_manager' (27ee33d4-33ed-4118-87e3-73c221654a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-347d0856-588f-4996-b0e7-ed5d2dd8a915 tempest-GroupsTest-386541257 None] Created volume successfully.
Jun 16 18:39:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5a33bb82-b4c9-47d5-ae97-f4483fdd7fae tempest-GroupsTest-386541257 None] Update group completed successfully.
Jun 16 18:39:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-130e6afa-6cb2-465c-9256-37f21cbdc370 tempest-GroupsTest-386541257 None] Update group completed successfully.
Jun 16 18:39:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Acquiring lock "cinder-quobyte-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Lock "cinder-quobyte-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8" acquired by "delete_volume" :: waited 0.030s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fe62b8-d782-4c3e-bc2d-2012f1699117]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:25 devstack sudo[96886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8
Jun 16 18:39:25 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:26 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8" returned: 0 in 1.368s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:26 devstack sudo[96892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8
Jun 16 18:39:26 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:27 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8" returned: 0 in 1.057s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Lock "cinder-quobyte-c3b2cd3c-ee9b-403a-98ed-ec0825c88af8" released by "delete_volume" :: held 2.496s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Acquiring lock "cinder-quobyte-fc8434af-b2f3-478c-aada-be74986af879" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Lock "cinder-quobyte-fc8434af-b2f3-478c-aada-be74986af879" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c94eb-52c7-46d8-b23f-024969369b7b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:27 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879
Jun 16 18:39:27 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:28 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879" returned: 0 in 0.761s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:28 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879
Jun 16 18:39:28 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:29 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fc8434af-b2f3-478c-aada-be74986af879" returned: 0 in 0.670s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Lock "cinder-quobyte-fc8434af-b2f3-478c-aada-be74986af879" released by "delete_volume" :: held 1.492s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Created reservations ['23d4f79c-942b-42f7-ba89-0ca298a76b56'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:29 devstack cinder-volume[91851]: WARNING cinder.quota [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1221477639 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1221477639, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:39:29 devstack cinder-volume[91851]: WARNING cinder.quota [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1221477639 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1221477639, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Created reservations ['8b9977d9-aacb-4965-b2d8-a13aaf9799b7', '89b07eef-accd-4496-8b22-788c4fd6bbfe', '0fc00696-0db4-4960-b4da-3a9403621cfa', '231fa672-78e6-4c58-807f-daea85c48518'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Created reservations ['8ee8b353-cb76-43ee-a5a8-fde397db5649', '490ab383-6b86-46b8-97e3-8f094fadc195', 'dd711277-4798-4758-9506-544362ea9785', '4f76cf59-e75b-4af9-9206-1ae904211dac'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:29 devstack sudo[96904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:29 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:30 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.061s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Flow 'volume_create_manager' (23bfdb95-5898-4eea-9d77-819b41f68520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412b735-9d3b-44d0-a8fb-aeb0c4fd8be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6a514450-7eaa-4c2f-be7f-a4fdf0a425fa tempest-GroupsTest-386541257 None] Delete group completed successfully.
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412b735-9d3b-44d0-a8fb-aeb0c4fd8be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-392475177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57ff4e3-262e-4896-9bcb-c5c32fde304e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd9422348164525877ba36a3d76d1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:31Z,use_quota=True,user_id='8002323fc7734371b7cc3bf373b5ea51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b7b6fa-f574-4e0e-b820-69d4836e4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b7b6fa-f574-4e0e-b820-69d4836e4191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9f596d-454e-4cbe-85fc-e7e0e63d71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9f596d-454e-4cbe-85fc-e7e0e63d71d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57ff4e3-262e-4896-9bcb-c5c32fde304e', 'volume_name': 'volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2cacf7-020d-404f-8515-96f894c38395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2cacf7-020d-404f-8515-96f894c38395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056d51e2-24ca-4b1b-a12b-5cda51d2a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:30 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Volume f57ff4e3-262e-4896-9bcb-c5c32fde304e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e', 'volume_size': 1}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-392475177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57ff4e3-262e-4896-9bcb-c5c32fde304e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd9422348164525877ba36a3d76d1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:31Z,use_quota=True,user_id='8002323fc7734371b7cc3bf373b5ea51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Creating volume f57ff4e3-262e-4896-9bcb-c5c32fde304e {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:30 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:30 devstack sudo[96909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e 1073741824
Jun 16 18:39:30 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:31 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e 1073741824" returned: 0 in 1.036s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:31 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e
Jun 16 18:39:31 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:32 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e" returned: 0 in 0.683s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056d51e2-24ca-4b1b-a12b-5cda51d2a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb390dfb-b394-456c-9905-640c0be9439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:32 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Volume volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e (f57ff4e3-262e-4896-9bcb-c5c32fde304e): created successfully
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb390dfb-b394-456c-9905-640c0be9439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Flow 'volume_create_manager' (23bfdb95-5898-4eea-9d77-819b41f68520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:32 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e5e5168a-4655-4573-9bbe-c59312d9a1e0 tempest-AttachVolumeShelveTestJSON-917558730 None] Created volume successfully.
Jun 16 18:39:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9445a952-88eb-4e9e-b077-c4859eb33967 tempest-GroupsV320Test-1684866029 None] Group tempest-GroupsV320Test-Group-1110596397: creating
Jun 16 18:39:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9445a952-88eb-4e9e-b077-c4859eb33967 tempest-GroupsV320Test-1684866029 None] Group tempest-GroupsV320Test-Group-1110596397: created successfully
Jun 16 18:39:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9445a952-88eb-4e9e-b077-c4859eb33967 tempest-GroupsV320Test-1684866029 None] Create group completed successfully.
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Created reservations ['bec24bf8-51d9-4274-adcf-fee985191687'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:38 devstack sudo[96975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:38 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:39 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.681s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:39 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-54b7d7c3-f1cf-45fd-944c-cd5f662775f3 tempest-GroupsV320Test-1684866029 None] Delete group completed successfully.
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Flow 'volume_create_manager' (c86f56b6-7dca-4a78-a32a-e3c6cd5388e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e681a7-1f51-48ba-9e0a-75687e79ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e681a7-1f51-48ba-9e0a-75687e79ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-532268649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881e357b-0ee9-40db-9a3d-fff9acfa904d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81240a5a4c144b3880d6d5471f587ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:41Z,use_quota=True,user_id='677df3ed451843e5a1d1a3f8ec016d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3baa3756-89ba-40e6-a5b2-962905802dac),volume_type_id=3baa3756-89ba-40e6-a5b2-962905802dac)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5011b19b-1063-4d1a-a0f4-43f94cde18ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5011b19b-1063-4d1a-a0f4-43f94cde18ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94ea65a-02d3-493a-b4d5-f30a19fca377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94ea65a-02d3-493a-b4d5-f30a19fca377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881e357b-0ee9-40db-9a3d-fff9acfa904d', 'volume_name': 'volume-881e357b-0ee9-40db-9a3d-fff9acfa904d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa3afa4-afba-49ef-91fc-45a4a3009fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa3afa4-afba-49ef-91fc-45a4a3009fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f1fc8-e6ea-47ab-924d-8b2e655306e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:41 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Volume 881e357b-0ee9-40db-9a3d-fff9acfa904d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881e357b-0ee9-40db-9a3d-fff9acfa904d', 'volume_size': 1}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-532268649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881e357b-0ee9-40db-9a3d-fff9acfa904d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81240a5a4c144b3880d6d5471f587ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:41Z,use_quota=True,user_id='677df3ed451843e5a1d1a3f8ec016d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3baa3756-89ba-40e6-a5b2-962905802dac),volume_type_id=3baa3756-89ba-40e6-a5b2-962905802dac)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Creating volume 881e357b-0ee9-40db-9a3d-fff9acfa904d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:41 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:41 devstack sudo[96979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d 1073741824
Jun 16 18:39:41 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:42 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:42 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:42 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d 1073741824" returned: 0 in 1.195s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:42 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d
Jun 16 18:39:42 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:43 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.248s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 8 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:39:43 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d" returned: 0 in 1.220s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] <== create_volume: return (2481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.489s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f1fc8-e6ea-47ab-924d-8b2e655306e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881e357b-0ee9-40db-9a3d-fff9acfa904d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d6b5e1-442a-4f96-8c41-b3f2436ef7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:43 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Volume volume-881e357b-0ee9-40db-9a3d-fff9acfa904d (881e357b-0ee9-40db-9a3d-fff9acfa904d): created successfully
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d6b5e1-442a-4f96-8c41-b3f2436ef7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Flow 'volume_create_manager' (c86f56b6-7dca-4a78-a32a-e3c6cd5388e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f6b4d4eb-3d54-4fa5-8ae8-0e2d89eeb51d tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Created volume successfully.
Jun 16 18:39:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:44 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:44 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:45 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.667s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:45 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:45 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0709783d-6560-4bd3-8d15-5affbfd90129 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Retype volume completed successfully.
Jun 16 18:39:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Acquiring lock "cinder-881e357b-0ee9-40db-9a3d-fff9acfa904d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "cinder-881e357b-0ee9-40db-9a3d-fff9acfa904d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Acquiring lock "cinder-quobyte-881e357b-0ee9-40db-9a3d-fff9acfa904d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "cinder-quobyte-881e357b-0ee9-40db-9a3d-fff9acfa904d" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:46 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec9a41-bc94-4c14-89fd-3f6330fa525e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:46 devstack sudo[97023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d
Jun 16 18:39:46 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:47 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d" returned: 0 in 0.818s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:47 devstack sudo[97029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d
Jun 16 18:39:47 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:47 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-881e357b-0ee9-40db-9a3d-fff9acfa904d" returned: 0 in 0.737s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "cinder-quobyte-881e357b-0ee9-40db-9a3d-fff9acfa904d" released by "delete_volume" :: held 1.605s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:47 devstack cinder-volume[91851]: WARNING cinder.quota [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:39:47 devstack cinder-volume[91851]: WARNING cinder.quota [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Created reservations ['a54078ed-5265-4069-91ed-4f109e21fbcf', '1774207e-c6bc-4fd9-9dff-375d954dbf38', '9aea04a6-abe8-44f9-8880-f37a76bddf33', 'd88d49e7-d11d-4f76-b765-6b6503a54548'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:47 devstack sudo[97032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:47 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:48 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.745s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Deleted volume successfully.
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Flow 'volume_create_manager' (02194fe6-9f29-40cc-8c44-2ca8e388c605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcacb3a-2b7b-4e84-baaf-13021f44b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1a0a2338-6ae2-4aaa-932f-e6d5fb4b9d71 tempest-VolumeRetypeWithoutMigrationTest-1703117315 None] Lock "cinder-881e357b-0ee9-40db-9a3d-fff9acfa904d-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcacb3a-2b7b-4e84-baaf-13021f44b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-617997649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a093a8e3-cab6-4a3c-b47c-6c1f98d7003a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ef8af97ea4412b3353d6ae5c9eff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:49Z,use_quota=True,user_id='34d6eb1db3de44dda89cd4a60ce0bf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a66df-eefb-4a70-b1ca-a214045894b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a66df-eefb-4a70-b1ca-a214045894b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fb97da-8c1d-4d10-99f7-ee816ed96965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fb97da-8c1d-4d10-99f7-ee816ed96965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a093a8e3-cab6-4a3c-b47c-6c1f98d7003a', 'volume_name': 'volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60daf7e6-e153-4bcf-bb11-fa39ad8a5f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60daf7e6-e153-4bcf-bb11-fa39ad8a5f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f0e07f-b77b-4179-a996-1d29fce70e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Volume a093a8e3-cab6-4a3c-b47c-6c1f98d7003a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a', 'volume_size': 1}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-617997649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a093a8e3-cab6-4a3c-b47c-6c1f98d7003a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ef8af97ea4412b3353d6ae5c9eff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:49Z,use_quota=True,user_id='34d6eb1db3de44dda89cd4a60ce0bf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Creating volume a093a8e3-cab6-4a3c-b47c-6c1f98d7003a {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:48 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:48 devstack sudo[97038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a 1073741824
Jun 16 18:39:48 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:49 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a 1073741824" returned: 0 in 0.997s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:49 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a
Jun 16 18:39:49 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:51 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a" returned: 0 in 1.107s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f0e07f-b77b-4179-a996-1d29fce70e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d90e205-fc91-4354-b17b-81e59afd8e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:51 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Volume volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a (a093a8e3-cab6-4a3c-b47c-6c1f98d7003a): created successfully
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d90e205-fc91-4354-b17b-81e59afd8e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Flow 'volume_create_manager' (02194fe6-9f29-40cc-8c44-2ca8e388c605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a5119460-3f56-47b5-a693-6991036b857b tempest-VolumeQuotasAdminTestJSON-999148915 None] Created volume successfully.
Jun 16 18:39:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "cinder-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "cinder-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "cinder-quobyte-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:39:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "cinder-quobyte-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:39:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[afac5853-2f8a-4b62-baee-9a412f5decee]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:52 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a
Jun 16 18:39:52 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:53 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a" returned: 0 in 1.029s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:53 devstack sudo[97119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a
Jun 16 18:39:53 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:54 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a" returned: 0 in 0.848s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "cinder-quobyte-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a" released by "delete_volume" :: held 1.938s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Created reservations ['7bc04d3f-4d65-42d1-9b85-38be5f916eda', '1475c774-735f-4728-bb4f-1ff942ca3c4c', '228930b5-2eaf-4dda-a7fb-9e731f73b003', 'c4869ee3-c52d-4e77-8079-de652192e893'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:54 devstack sudo[97122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:39:54 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e7d700-a6ef-4794-9783-c334aba740f1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Flow 'volume_create_manager' (843d99f4-43c7-4c1e-a8fc-6b929e36e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:55 devstack sudo[97132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad52db6-236b-44e5-9e4b-78468911be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:55 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad52db6-236b-44e5-9e4b-78468911be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1761048002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782fe1d8-53c5-4307-b867-8aacd5f4bd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ef8af97ea4412b3353d6ae5c9eff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:55Z,use_quota=True,user_id='34d6eb1db3de44dda89cd4a60ce0bf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742687cc-3493-4244-8a6d-b27a8341a5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742687cc-3493-4244-8a6d-b27a8341a5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aa45ad-bf4c-4329-8ef2-318350076500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aa45ad-bf4c-4329-8ef2-318350076500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782fe1d8-53c5-4307-b867-8aacd5f4bd4f', 'volume_name': 'volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9f0115-6e35-4533-8505-f019f144329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9f0115-6e35-4533-8505-f019f144329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d37b545-cd2f-4e04-9923-cc6719fa9d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:55 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Volume 782fe1d8-53c5-4307-b867-8aacd5f4bd4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f', 'volume_size': 1}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:55 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.423s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:39:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Deleted volume successfully.
Jun 16 18:39:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ebe0e3d0-01bc-4030-b4bb-e0c63dce6256 tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "cinder-a093a8e3-cab6-4a3c-b47c-6c1f98d7003a-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:39:56 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e" returned: 0 in 1.139s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.197s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1761048002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782fe1d8-53c5-4307-b867-8aacd5f4bd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3ef8af97ea4412b3353d6ae5c9eff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:55Z,use_quota=True,user_id='34d6eb1db3de44dda89cd4a60ce0bf2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Creating volume 782fe1d8-53c5-4307-b867-8aacd5f4bd4f {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:56 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:56 devstack sudo[97140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f 1073741824
Jun 16 18:39:56 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34c7f19d-a365-4f43-9a93-58c8179ae896', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:39:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-a410d014-74d0-4afe-8f46-eeba645c6e8e req-968cc024-487e-4045-a098-0d088a74e7f2 tempest-AttachVolumeShelveTestJSON-917558730 None] attachment_update completed successfully.
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Flow 'volume_create_manager' (2a84f744-7cb9-41d0-a327-323de3d2dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2371ea2-0459-4e2f-81c8-8c7a48e06e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2371ea2-0459-4e2f-81c8-8c7a48e06e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1543339229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d447cf-f50e-4dc8-97f3-2f394f6015c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cceeb7c4d640d3a838f12f35f7c754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:57Z,use_quota=True,user_id='f5ce54452b1c435eabf1cca1fe0b9ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbfb8e5-c2f6-4957-918d-a5be9bbfeae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbfb8e5-c2f6-4957-918d-a5be9bbfeae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ca08d5-8a48-4932-ab2c-ebf125c54b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ca08d5-8a48-4932-ab2c-ebf125c54b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d447cf-f50e-4dc8-97f3-2f394f6015c8', 'volume_name': 'volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978bf59f-64ed-402a-85ea-1f8ef576bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978bf59f-64ed-402a-85ea-1f8ef576bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffaa32e-3f64-4451-9eeb-016b020b1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Volume a5d447cf-f50e-4dc8-97f3-2f394f6015c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8', 'volume_size': 1}
Jun 16 18:39:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:57 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f 1073741824" returned: 0 in 0.957s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:57 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f
Jun 16 18:39:57 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:57 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1543339229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d447cf-f50e-4dc8-97f3-2f394f6015c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cceeb7c4d640d3a838f12f35f7c754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:39:57Z,use_quota=True,user_id='f5ce54452b1c435eabf1cca1fe0b9ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Creating volume a5d447cf-f50e-4dc8-97f3-2f394f6015c8 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:39:58 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:58 devstack sudo[97149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 1073741824
Jun 16 18:39:58 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d37b545-cd2f-4e04-9923-cc6719fa9d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99b907-48d6-436c-94eb-6262792c3243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Volume volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f (782fe1d8-53c5-4307-b867-8aacd5f4bd4f): created successfully
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99b907-48d6-436c-94eb-6262792c3243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Flow 'volume_create_manager' (843d99f4-43c7-4c1e-a8fc-6b929e36e42d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-cecf174f-e46a-4956-bb7e-34a9b93ab4aa tempest-VolumeQuotasAdminTestJSON-999148915 None] Created volume successfully.
Jun 16 18:39:58 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 1073741824" returned: 0 in 0.852s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:39:58 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8
Jun 16 18:39:58 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:39:59 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8" returned: 0 in 0.649s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffaa32e-3f64-4451-9eeb-016b020b1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1903c76e-0230-47d1-a0f8-996987740e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:39:59 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Volume volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 (a5d447cf-f50e-4dc8-97f3-2f394f6015c8): created successfully
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1903c76e-0230-47d1-a0f8-996987740e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:39:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Flow 'volume_create_manager' (2a84f744-7cb9-41d0-a327-323de3d2dee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:39:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-dcd35d25-b6a1-46bc-b3ce-bde5dc30bdb2 tempest-VolumeQuotasAdminTestJSON-1799233572 None] Transfer volume completed successfully.
Jun 16 18:39:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3508190c-ab13-4564-a2aa-046540033ad0 tempest-VolumesServicesTestJSON-817644283 None] Created volume successfully.
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Acquiring lock "cinder-a5d447cf-f50e-4dc8-97f3-2f394f6015c8-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Lock "cinder-a5d447cf-f50e-4dc8-97f3-2f394f6015c8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Acquiring lock "cinder-quobyte-a5d447cf-f50e-4dc8-97f3-2f394f6015c8" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Lock "cinder-quobyte-a5d447cf-f50e-4dc8-97f3-2f394f6015c8" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4038a251-dacd-4788-bdd7-2b1b6ef34648]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:00 devstack sudo[97159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8
Jun 16 18:40:00 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Acquiring lock "cinder-782fe1d8-53c5-4307-b867-8aacd5f4bd4f-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Lock "cinder-782fe1d8-53c5-4307-b867-8aacd5f4bd4f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Acquiring lock "cinder-quobyte-782fe1d8-53c5-4307-b867-8aacd5f4bd4f" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Lock "cinder-quobyte-782fe1d8-53c5-4307-b867-8aacd5f4bd4f" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8198c2a-70fe-4376-9d91-87c2a1837309]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:00 devstack sudo[97161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f
Jun 16 18:40:00 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:01 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8" returned: 0 in 0.827s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:01 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8
Jun 16 18:40:01 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:01 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a5d447cf-f50e-4dc8-97f3-2f394f6015c8" returned: 0 in 0.758s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Lock "cinder-quobyte-a5d447cf-f50e-4dc8-97f3-2f394f6015c8" released by "delete_volume" :: held 1.646s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:01 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f" returned: 0 in 0.985s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=112,cinder:SELECT=86,cinder:DELETE=4,cinder:INSERT=14 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:40:01 devstack sudo[97172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f
Jun 16 18:40:01 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Created reservations ['727b1aa7-cc5e-4210-9498-f245ae23cdca', '9cb942dc-8591-4c5c-826d-571e9c01d94d', 'a406e122-6908-4de0-baff-330ef325013d', 'f4309062-8b3e-4f13-82a5-e4062c9608d9'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:02 devstack sudo[97174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:02 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:02 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-782fe1d8-53c5-4307-b867-8aacd5f4bd4f" returned: 0 in 1.183s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Lock "cinder-quobyte-782fe1d8-53c5-4307-b867-8aacd5f4bd4f" released by "delete_volume" :: held 2.231s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:03 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.054s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Deleted volume successfully.
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fbeb4a6-82aa-4d22-979b-b33f9e5a849d tempest-VolumesServicesTestJSON-817644283 None] Lock "cinder-a5d447cf-f50e-4dc8-97f3-2f394f6015c8-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Created reservations ['d71db927-7731-4a5f-8e50-faa540516c0c', 'e3e00f1a-f952-4694-be8c-24aaf650fa2e', 'aa842a33-27a5-435c-9354-1a4e983253fa', 'baefa1ce-3a8b-47ed-aadd-1ab133fdeb50'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:03 devstack sudo[97180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:03 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:04 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.921s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:04 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Deleted volume successfully.
Jun 16 18:40:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1cc87084-6c31-4629-9274-69f7014c3f5f tempest-VolumeQuotasAdminTestJSON-939500928 None] Lock "cinder-782fe1d8-53c5-4307-b867-8aacd5f4bd4f-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=92,cinder:SELECT=92,cinder:INSERT=24,cinder:DELETE=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Flow 'volume_create_manager' (5ddd7233-422a-40d2-98a5-e315838f9b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf512f8a-6b6b-4227-9d86-008f446016fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf512f8a-6b6b-4227-9d86-008f446016fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1577237216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7e0e59-3255-477a-8b18-11fed8841774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a071b9e23d324684a407d557d80a7940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:13Z,use_quota=True,user_id='8b0011652c8e4430a6564081969cceb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b29b0c-1990-4533-8135-44ef16e861c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b29b0c-1990-4533-8135-44ef16e861c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5a72bc-33be-49a4-8857-0977c857882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5a72bc-33be-49a4-8857-0977c857882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d7e0e59-3255-477a-8b18-11fed8841774', 'volume_name': 'volume-8d7e0e59-3255-477a-8b18-11fed8841774', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3600397-25a7-4c74-8c2e-0f76da9295f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3600397-25a7-4c74-8c2e-0f76da9295f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acd7085-4a25-495a-a1e7-8a5e8b7e0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:13 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Volume 8d7e0e59-3255-477a-8b18-11fed8841774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d7e0e59-3255-477a-8b18-11fed8841774', 'volume_size': 1}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1577237216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7e0e59-3255-477a-8b18-11fed8841774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a071b9e23d324684a407d557d80a7940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:13Z,use_quota=True,user_id='8b0011652c8e4430a6564081969cceb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Creating volume 8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:13 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:13 devstack sudo[97320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 1073741824
Jun 16 18:40:13 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:14 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 1073741824" returned: 0 in 0.743s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:14 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774
Jun 16 18:40:14 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:14 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774" returned: 0 in 0.791s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:40:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acd7085-4a25-495a-a1e7-8a5e8b7e0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d7e0e59-3255-477a-8b18-11fed8841774', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1bd7a3-4d78-40fe-bf7e-1146c7463390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:15 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Volume volume-8d7e0e59-3255-477a-8b18-11fed8841774 (8d7e0e59-3255-477a-8b18-11fed8841774): created successfully
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1bd7a3-4d78-40fe-bf7e-1146c7463390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Flow 'volume_create_manager' (5ddd7233-422a-40d2-98a5-e315838f9b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-057d0ced-59b5-4605-9cce-065bf6254581 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Created volume successfully.
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Creating offline snapshot c38c551c-64d4-4146-a461-599afbaf4b2e of volume 8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be3856a-53f9-4ef8-aa9d-4756cf6019a6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:16 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774
Jun 16 18:40:16 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Flow 'volume_create_manager' (8b38e3f9-cbe5-47e7-9571-13bf772e0d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac997048-2b22-4140-ac67-8c0e7769f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac997048-2b22-4140-ac67-8c0e7769f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221712542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f73a124-ce83-4cd0-b5ec-e0042b015f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d259135052047d4b9dcf7a2018bc024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:17Z,use_quota=True,user_id='c09dc86fda344d13b2b94482309a8003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5f6f1a-2b92-4b0b-a647-785c2c90c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5f6f1a-2b92-4b0b-a647-785c2c90c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09aa1b38-ecd4-4e0c-9fb5-84782c2e0378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09aa1b38-ecd4-4e0c-9fb5-84782c2e0378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f73a124-ce83-4cd0-b5ec-e0042b015f78', 'volume_name': 'volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acbd7b2-4a72-490d-9855-96d613b459e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acbd7b2-4a72-490d-9855-96d613b459e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f95cf91-4afb-4b61-a0b0-559385fe11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Volume 3f73a124-ce83-4cd0-b5ec-e0042b015f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78', 'volume_size': 1}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:17 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774" returned: 0 in 1.300s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:17 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e 1G
Jun 16 18:40:17 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:18 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e 1G" returned: 0 in 0.950s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d7e0e59-3255-477a-8b18-11fed8841774 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:18 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d7e0e59-3255-477a-8b18-11fed8841774 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e
Jun 16 18:40:18 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:18 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d7e0e59-3255-477a-8b18-11fed8841774 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e" returned: 0 in 0.738s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:18 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e is being set with open permissions: ugo+rw
Jun 16 18:40:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:18 devstack sudo[97730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e
Jun 16 18:40:18 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:19 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e" returned: 0 in 0.668s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:19 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info
Jun 16 18:40:19 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:20 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info" returned: 0 in 0.640s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:20 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info is being set with open permissions: ugo+rw
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:20 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info
Jun 16 18:40:20 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Flow 'volume_create_manager' (69c49c58-8766-462d-811f-15a0c9152561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48e4edd-1729-4226-acec-b66ea4bcb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48e4edd-1729-4226-acec-b66ea4bcb173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1811636603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7793867b-f8af-4db7-baf5-83164f2a6e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357ecb87d745415dae0932fd06fc418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:20Z,use_quota=True,user_id='b1b2ec05e2604db99ebdb5dcfa67f4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba12cb4-81c4-4963-9e06-9c06f97e91bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba12cb4-81c4-4963-9e06-9c06f97e91bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2002280b-fdc6-4767-97a6-6640a08e685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2002280b-fdc6-4767-97a6-6640a08e685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7793867b-f8af-4db7-baf5-83164f2a6e78', 'volume_name': 'volume-7793867b-f8af-4db7-baf5-83164f2a6e78', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbb24d1-334a-4119-b0c8-a2333b05e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbb24d1-334a-4119-b0c8-a2333b05e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e8c52d-feaf-48e7-8810-a97e26c8598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:20 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Volume 7793867b-f8af-4db7-baf5-83164f2a6e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7793867b-f8af-4db7-baf5-83164f2a6e78', 'volume_size': 1}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:20 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.info" returned: 0 in 0.643s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.048s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.746s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221712542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f73a124-ce83-4cd0-b5ec-e0042b015f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d259135052047d4b9dcf7a2018bc024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:17Z,use_quota=True,user_id='c09dc86fda344d13b2b94482309a8003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Creating volume 3f73a124-ce83-4cd0-b5ec-e0042b015f78 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:20 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:20 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 1073741824
Jun 16 18:40:20 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:20 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3767faf8-0414-4486-abda-ec91e6b3d62e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Create snapshot completed successfully
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "cinder-c38c551c-64d4-4146-a461-599afbaf4b2e-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-c38c551c-64d4-4146-a461-599afbaf4b2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "cinder-quobyte-8d7e0e59-3255-477a-8b18-11fed8841774" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-quobyte-8d7e0e59-3255-477a-8b18-11fed8841774" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "cinder-quobyte-c38c551c-64d4-4146-a461-599afbaf4b2e" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-quobyte-c38c551c-64d4-4146-a461-599afbaf4b2e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Deleting offline snapshot c38c551c-64d4-4146-a461-599afbaf4b2e of volume 8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] snapshot_file for this snap is: volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af9bd9-2161-42c5-955c-53d0168f1421]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:21 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 1073741824" returned: 0 in 0.855s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:21 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78
Jun 16 18:40:21 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:21 devstack sudo[97752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e
Jun 16 18:40:21 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:22 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78" returned: 0 in 0.651s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.928s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1811636603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7793867b-f8af-4db7-baf5-83164f2a6e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357ecb87d745415dae0932fd06fc418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:20Z,use_quota=True,user_id='b1b2ec05e2604db99ebdb5dcfa67f4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Creating volume 7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:22 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:22 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e" returned: 0 in 0.779s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d7e0e59-3255-477a-8b18-11fed8841774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:40:22 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 1073741824
Jun 16 18:40:22 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f95cf91-4afb-4b61-a0b0-559385fe11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4301905b-abbc-4498-9ae6-2b3e3717508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[765dcd95-dc89-4249-ab3b-43955df50c04]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:22 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Volume volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 (3f73a124-ce83-4cd0-b5ec-e0042b015f78): created successfully
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4301905b-abbc-4498-9ae6-2b3e3717508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Flow 'volume_create_manager' (8b38e3f9-cbe5-47e7-9571-13bf772e0d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e5ff5b79-05bc-4005-b600-672dfafddf92 tempest-AttachVolumeTestJSON-1918294011 None] Created volume successfully.
Jun 16 18:40:22 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774
Jun 16 18:40:22 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:23 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 1073741824" returned: 0 in 0.898s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:23 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774" returned: 0 in 0.902s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:23 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78
Jun 16 18:40:23 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e
Jun 16 18:40:23 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:23 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:24 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78" returned: 0 in 0.751s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e8c52d-feaf-48e7-8810-a97e26c8598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7793867b-f8af-4db7-baf5-83164f2a6e78', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c0051c-c2ce-49cb-9aa3-fdae5e4a4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:24 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Volume volume-7793867b-f8af-4db7-baf5-83164f2a6e78 (7793867b-f8af-4db7-baf5-83164f2a6e78): created successfully
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c0051c-c2ce-49cb-9aa3-fdae5e4a4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Flow 'volume_create_manager' (69c49c58-8766-462d-811f-15a0c9152561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:24 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e" returned: 0 in 0.786s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:24 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6fc9b768-ed6d-4dc4-914b-93f870736b80 tempest-SnapshotMetadataTestJSON-1202383084 None] Created volume successfully.
Jun 16 18:40:24 devstack sudo[97816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e
Jun 16 18:40:24 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:24 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774.c38c551c-64d4-4146-a461-599afbaf4b2e" returned: 0 in 0.638s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-quobyte-c38c551c-64d4-4146-a461-599afbaf4b2e" released by "_delete_snapshot" :: held 3.256s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-quobyte-8d7e0e59-3255-477a-8b18-11fed8841774" released by "delete_snapshot" :: held 3.286s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:25 devstack cinder-volume[91851]: WARNING cinder.quota [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Created reservations ['3d11ad4e-bebb-4016-a17a-c7ec509726d1', '06ea8255-397c-4fc7-9b26-86a8e1beff14', 'fd5a8935-a63c-4800-9706-6c79c30db9a4', 'ecd5128b-609b-43d4-891e-78fa2c7398dc'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Creating offline snapshot 717a807d-514f-4e97-9105-8da5e384817e of volume 7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec78bc41-44b4-4fd1-8d37-1c0638a74753]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Delete snapshot completed successfully.
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-43198f41-b558-41c5-9e07-94bdd42c59c5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-c38c551c-64d4-4146-a461-599afbaf4b2e-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:25 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78
Jun 16 18:40:25 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:25 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78" returned: 0 in 0.796s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:25 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e 1G
Jun 16 18:40:25 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "cinder-8d7e0e59-3255-477a-8b18-11fed8841774-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-8d7e0e59-3255-477a-8b18-11fed8841774-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "cinder-quobyte-8d7e0e59-3255-477a-8b18-11fed8841774" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-quobyte-8d7e0e59-3255-477a-8b18-11fed8841774" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47f5d06-978c-41d5-9bfa-30aa4458f97f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:26 devstack sudo[97826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774
Jun 16 18:40:26 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:26 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e 1G" returned: 0 in 0.930s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7793867b-f8af-4db7-baf5-83164f2a6e78 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:26 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7793867b-f8af-4db7-baf5-83164f2a6e78 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e
Jun 16 18:40:26 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:27 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774" returned: 0 in 0.861s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:27 devstack sudo[97846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774
Jun 16 18:40:27 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:27 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7793867b-f8af-4db7-baf5-83164f2a6e78 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e" returned: 0 in 0.656s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:27 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e is being set with open permissions: ugo+rw
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:27 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e
Jun 16 18:40:27 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:27 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8d7e0e59-3255-477a-8b18-11fed8841774" returned: 0 in 0.685s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-quobyte-8d7e0e59-3255-477a-8b18-11fed8841774" released by "delete_volume" :: held 1.631s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Created reservations ['a55edd83-d9e2-40eb-b222-e9cab6eb3249', '6d9258fd-af3b-453c-9b0b-a22fc5720331', 'ad9b3ee4-6917-4c98-9224-27b19b526a63', '360bdead-8975-430f-b577-76cb46a4b169'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:27 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:27 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:28 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e" returned: 0 in 0.636s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:28 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info
Jun 16 18:40:28 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:28 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.615s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:28 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Deleted volume successfully.
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-53376098-acb4-4cf1-8224-47409972010e tempest-VolumeSnapshotQuotasNegativeTestJSON-2145191355 None] Lock "cinder-8d7e0e59-3255-477a-8b18-11fed8841774-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:28 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info" returned: 0 in 0.739s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:28 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info is being set with open permissions: ugo+rw
Jun 16 18:40:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:28 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info
Jun 16 18:40:28 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:29 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.info" returned: 0 in 0.656s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.520s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.785s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:29 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac2cd2c-0dc4-4747-a803-46727de0687c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b2435a3a-5040-4542-92a9-4d7daa31613e tempest-SnapshotMetadataTestJSON-1202383084 None] Create snapshot completed successfully
Jun 16 18:40:29 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78
Jun 16 18:40:29 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:30 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78" returned: 0 in 0.744s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5eb9e914-675d-4ca0-b778-b9c3aafc9698', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:40:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-c1e1aca8-c18b-47d1-b491-b2aee281d231 req-1786a672-0c7d-48a5-ba8a-c901944d477f tempest-AttachVolumeTestJSON-1918294011 None] attachment_update completed successfully.
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "cinder-717a807d-514f-4e97-9105-8da5e384817e-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-717a807d-514f-4e97-9105-8da5e384817e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "cinder-quobyte-7793867b-f8af-4db7-baf5-83164f2a6e78" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-quobyte-7793867b-f8af-4db7-baf5-83164f2a6e78" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "cinder-quobyte-717a807d-514f-4e97-9105-8da5e384817e" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-quobyte-717a807d-514f-4e97-9105-8da5e384817e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Deleting offline snapshot 717a807d-514f-4e97-9105-8da5e384817e of volume 7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] snapshot_file for this snap is: volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80c158-6a15-4582-9c50-1978b1593de2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:31 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e
Jun 16 18:40:31 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:31 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e" returned: 0 in 0.795s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7793867b-f8af-4db7-baf5-83164f2a6e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[82961518-eb6a-425f-a4af-a35b20c4b9a8]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:32 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78
Jun 16 18:40:32 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:32 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78" returned: 0 in 0.750s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:32 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e
Jun 16 18:40:32 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:33 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:33 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e
Jun 16 18:40:33 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:34 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78.717a807d-514f-4e97-9105-8da5e384817e" returned: 0 in 0.599s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-quobyte-717a807d-514f-4e97-9105-8da5e384817e" released by "_delete_snapshot" :: held 2.976s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-quobyte-7793867b-f8af-4db7-baf5-83164f2a6e78" released by "delete_snapshot" :: held 3.013s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Created reservations ['585f14e1-3cf1-4867-9393-0dde69720bab', '8bd289b6-ee2a-473b-b326-8d562467c1b2', '4f861650-b5f1-4b8a-a53c-153ac7c1cfa2', '44bbad7f-33d0-4da6-9ddf-b3fad7246c5d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Delete snapshot completed successfully.
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f1c0b442-8b58-409f-a37d-0452f5ddb10f tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-717a807d-514f-4e97-9105-8da5e384817e-delete_snapshot" released by "delete_snapshot" :: held 3.200s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "cinder-7793867b-f8af-4db7-baf5-83164f2a6e78-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-7793867b-f8af-4db7-baf5-83164f2a6e78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "cinder-quobyte-7793867b-f8af-4db7-baf5-83164f2a6e78" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-quobyte-7793867b-f8af-4db7-baf5-83164f2a6e78" acquired by "delete_volume" :: waited 0.040s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[815c1e7f-e054-4c7e-8207-56725f6481a4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Flow 'volume_create_manager' (a1cfff6b-5c52-4e2a-8c3d-766d95dbbd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91733bb-4ba2-46e9-9d8d-29a3086ae367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91733bb-4ba2-46e9-9d8d-29a3086ae367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-967934633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a726a1-c1aa-4039-a2ca-80d5b47dadfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beaa61ed69b48cba31791b51086260b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:35Z,use_quota=True,user_id='e5a6b71aba954002af296d00967200a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35865c09-7681-445e-a29d-90e714ac0a1f),volume_type_id=35865c09-7681-445e-a29d-90e714ac0a1f)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19a5e1-4295-41a7-b3d3-3a9db5c6f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19a5e1-4295-41a7-b3d3-3a9db5c6f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ebaec9-2299-4bff-a1f6-359cda0d9fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ebaec9-2299-4bff-a1f6-359cda0d9fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a726a1-c1aa-4039-a2ca-80d5b47dadfa', 'volume_name': 'volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7785afa-fd73-4b2d-9bee-3acfc4a6bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:34 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78
Jun 16 18:40:34 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7785afa-fd73-4b2d-9bee-3acfc4a6bc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c83cc0c-3dc7-43eb-8616-8c55ec824a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:34 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Volume 72a726a1-c1aa-4039-a2ca-80d5b47dadfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa', 'volume_size': 1}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-967934633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a726a1-c1aa-4039-a2ca-80d5b47dadfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8beaa61ed69b48cba31791b51086260b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:35Z,use_quota=True,user_id='e5a6b71aba954002af296d00967200a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35865c09-7681-445e-a29d-90e714ac0a1f),volume_type_id=35865c09-7681-445e-a29d-90e714ac0a1f)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Creating volume 72a726a1-c1aa-4039-a2ca-80d5b47dadfa {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:34 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:34 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa 1073741824
Jun 16 18:40:34 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:35 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78" returned: 0 in 0.838s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:35 devstack sudo[97938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78
Jun 16 18:40:35 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:35 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa 1073741824" returned: 0 in 1.009s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:35 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa
Jun 16 18:40:35 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:36 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7793867b-f8af-4db7-baf5-83164f2a6e78" returned: 0 in 0.654s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-quobyte-7793867b-f8af-4db7-baf5-83164f2a6e78" released by "delete_volume" :: held 1.582s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Created reservations ['5c54f3e1-d5a0-4170-a7f0-f017a964a1d1', '11cdef8e-c909-47ae-975c-951855415d15', '385254e9-5899-4796-8738-d21625aaa290', 'e815eee0-a3a7-405b-921b-4afbba34bd47'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:36 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:36 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:36 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa" returned: 0 in 0.619s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c83cc0c-3dc7-43eb-8616-8c55ec824a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7edd185-0913-4f38-a0ff-e2b76d2ddea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:36 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Volume volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa (72a726a1-c1aa-4039-a2ca-80d5b47dadfa): created successfully
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7edd185-0913-4f38-a0ff-e2b76d2ddea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Flow 'volume_create_manager' (a1cfff6b-5c52-4e2a-8c3d-766d95dbbd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-29a240e5-b9ef-4e0c-8b17-8d63f78b22f5 tempest-VolumeTypesAccessTest-684700667 None] Created volume successfully.
Jun 16 18:40:36 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Deleted volume successfully.
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Acquiring lock "cinder-72a726a1-c1aa-4039-a2ca-80d5b47dadfa-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b73db102-9238-4d4e-95ea-45423a4461bb tempest-SnapshotMetadataTestJSON-1202383084 None] Lock "cinder-7793867b-f8af-4db7-baf5-83164f2a6e78-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Lock "cinder-72a726a1-c1aa-4039-a2ca-80d5b47dadfa-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Acquiring lock "cinder-quobyte-72a726a1-c1aa-4039-a2ca-80d5b47dadfa" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Lock "cinder-quobyte-72a726a1-c1aa-4039-a2ca-80d5b47dadfa" acquired by "delete_volume" :: waited 0.048s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90133e0-d085-4ced-9d14-006272238821]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:37 devstack sudo[97971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa
Jun 16 18:40:37 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:38 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa" returned: 0 in 1.089s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:38 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa
Jun 16 18:40:38 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:38 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72a726a1-c1aa-4039-a2ca-80d5b47dadfa" returned: 0 in 0.686s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Lock "cinder-quobyte-72a726a1-c1aa-4039-a2ca-80d5b47dadfa" released by "delete_volume" :: held 1.837s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:38 devstack cinder-volume[91851]: WARNING cinder.quota [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-924803422 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-924803422, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:40:38 devstack cinder-volume[91851]: WARNING cinder.quota [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-924803422 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-924803422, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:40:38 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Created reservations ['4dce9a1f-545a-4174-b9e0-785a2224177f', 'e6d9f42e-244a-41ed-9cfd-17de1dfbbdf4', '7809b695-e6a8-460f-8996-585960886071', '0488b10b-407a-444b-bd0e-4d1be5c5d404'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:39 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:39 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-cca539e2-0ddd-4f3c-8a55-3292bce4d8c6 req-90f3db30-9500-47af-97cf-bcf9d12b36f5 tempest-AttachVolumeShelveTestJSON-917558730 None] Terminate volume connection completed successfully.
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-cca539e2-0ddd-4f3c-8a55-3292bce4d8c6 req-90f3db30-9500-47af-97cf-bcf9d12b36f5 tempest-AttachVolumeShelveTestJSON-917558730 None] Deleting attachment 34c7f19d-a365-4f43-9a93-58c8179ae896. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:40:39 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.795s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Deleted volume successfully.
Jun 16 18:40:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1da0920d-2d91-4bc7-adf7-8708c7ac4523 tempest-VolumeTypesAccessTest-684700667 None] Lock "cinder-72a726a1-c1aa-4039-a2ca-80d5b47dadfa-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:42 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:42 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Flow 'volume_create_manager' (baa4de5c-ab4f-454c-9140-d59eeb34fce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b4dd78-7ad3-4cef-bbe3-82431470d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b4dd78-7ad3-4cef-bbe3-82431470d39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-142213521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d53611-dc36-4bd1-bdd6-0f17df3404cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4bdbe197e3475b92fbfb878e99e1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:42Z,use_quota=True,user_id='51e2b9be83dc4dce9853b98ccb7980c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb43cdf-448e-4c07-87b4-bd71dc7282a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb43cdf-448e-4c07-87b4-bd71dc7282a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57556db-4105-4ff9-a538-e410d1ff7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57556db-4105-4ff9-a538-e410d1ff7efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d53611-dc36-4bd1-bdd6-0f17df3404cc', 'volume_name': 'volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c2c370-2511-4f62-9819-ca3b6638253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c2c370-2511-4f62-9819-ca3b6638253e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195ff8b7-0b7f-44ba-9d35-15843bef67b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Volume 81d53611-dc36-4bd1-bdd6-0f17df3404cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc', 'volume_size': 1}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-142213521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d53611-dc36-4bd1-bdd6-0f17df3404cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4bdbe197e3475b92fbfb878e99e1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:42Z,use_quota=True,user_id='51e2b9be83dc4dce9853b98ccb7980c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Creating volume 81d53611-dc36-4bd1-bdd6-0f17df3404cc {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:42 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc 1073741824
Jun 16 18:40:42 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:42 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.860s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 8 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:40:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:40:43 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc 1073741824" returned: 0 in 1.432s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:43 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc
Jun 16 18:40:43 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:44 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc" returned: 0 in 0.710s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195ff8b7-0b7f-44ba-9d35-15843bef67b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2339d2-4cdb-4c54-9cb1-7d9e9aaaa5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:44 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Volume volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc (81d53611-dc36-4bd1-bdd6-0f17df3404cc): created successfully
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2339d2-4cdb-4c54-9cb1-7d9e9aaaa5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Flow 'volume_create_manager' (baa4de5c-ab4f-454c-9140-d59eeb34fce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ee843e17-4482-488f-b66d-4a6c60ce295c tempest-VolumesTransfersTest-1598961043 None] Created volume successfully.
Jun 16 18:40:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-dc155b77-4d01-4808-8fc5-8fd07137823d tempest-VolumesTransfersTest-690522607 None] Transfer volume completed successfully.
Jun 16 18:40:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Acquiring lock "cinder-81d53611-dc36-4bd1-bdd6-0f17df3404cc-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Lock "cinder-81d53611-dc36-4bd1-bdd6-0f17df3404cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Acquiring lock "cinder-quobyte-81d53611-dc36-4bd1-bdd6-0f17df3404cc" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Lock "cinder-quobyte-81d53611-dc36-4bd1-bdd6-0f17df3404cc" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7816df-f86d-4e9b-afb9-ae6d1cacf86b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:47 devstack sudo[98168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc
Jun 16 18:40:47 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:48 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc" returned: 0 in 0.815s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:48 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc
Jun 16 18:40:48 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:49 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-81d53611-dc36-4bd1-bdd6-0f17df3404cc" returned: 0 in 1.379s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Lock "cinder-quobyte-81d53611-dc36-4bd1-bdd6-0f17df3404cc" released by "delete_volume" :: held 2.293s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Created reservations ['5af7ad54-cbbd-4144-a32d-db9800143bc4', '18607989-f5b6-4e7f-9643-adf825d97926', 'e6d4fe64-86a8-4f3a-a806-10510a8d8658', 'dd973ae8-58f0-4afd-a129-fb379767513e'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:49 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:49 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:50 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.907s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:50 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Deleted volume successfully.
Jun 16 18:40:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6cf6320f-2705-44b6-94d1-d832a2794457 tempest-VolumesTransfersTest-2166346 None] Lock "cinder-81d53611-dc36-4bd1-bdd6-0f17df3404cc-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:51 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Flow 'volume_create_manager' (b9ca4b4b-5273-4ebb-9e3f-68337eca3f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c2f95e-e279-466c-9e5f-6bf55a89167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c2f95e-e279-466c-9e5f-6bf55a89167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-391786920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4bdbe197e3475b92fbfb878e99e1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:52Z,use_quota=True,user_id='51e2b9be83dc4dce9853b98ccb7980c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6b3cab-1dbb-4ea2-b041-463d370f2a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6b3cab-1dbb-4ea2-b041-463d370f2a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc63c65e-ecc8-4e27-a380-ff094075160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc63c65e-ecc8-4e27-a380-ff094075160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d', 'volume_name': 'volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eea2f68-c230-4247-a8b0-e92a8ba3ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eea2f68-c230-4247-a8b0-e92a8ba3ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c16164-8437-43ec-a6df-3a298657573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:52 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Volume 7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d', 'volume_size': 1}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-391786920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4bdbe197e3475b92fbfb878e99e1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:52Z,use_quota=True,user_id='51e2b9be83dc4dce9853b98ccb7980c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Creating volume 7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:52 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:52 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d 1073741824
Jun 16 18:40:52 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:53 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d 1073741824" returned: 0 in 1.158s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:53 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d
Jun 16 18:40:53 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:54 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d" returned: 0 in 0.709s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c16164-8437-43ec-a6df-3a298657573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fece653-b160-4e74-810a-900b2298a308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:54 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Volume volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d (7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d): created successfully
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fece653-b160-4e74-810a-900b2298a308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Flow 'volume_create_manager' (b9ca4b4b-5273-4ebb-9e3f-68337eca3f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b017b888-663b-4a78-a8bc-78ac13c679be tempest-VolumesTransfersTest-1598961043 None] Created volume successfully.
Jun 16 18:40:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Acquiring lock "cinder-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Lock "cinder-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Acquiring lock "cinder-quobyte-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:40:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Lock "cinder-quobyte-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:40:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[49588fe3-4f30-4209-8e45-f4d3483ad14e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:40:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:55 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d
Jun 16 18:40:55 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:56 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d" returned: 0 in 0.857s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:56 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d
Jun 16 18:40:56 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:57 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d" returned: 0 in 0.643s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Lock "cinder-quobyte-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d" released by "delete_volume" :: held 1.554s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Created reservations ['0980ad2c-9b70-411e-baa7-e0a8e3176778', '191f96e6-578c-4c2a-ab8f-2e62c1f5df43', 'e8d6c353-0eed-40c1-acc2-ba5477702f17', 'da8d1f04-2e09-43d2-817b-fc6c0fe095a9'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:57 devstack sudo[98578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:40:57 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:58 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.886s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:40:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Deleted volume successfully.
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-55f351ba-4a78-4866-bfb3-0b061c96e49e tempest-VolumesTransfersTest-2166346 None] Lock "cinder-7f06ff33-e64d-4fdc-9d2e-1cd0e62f622d-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Flow 'volume_create_manager' (20f44019-abc2-49fa-a204-3aebf1fe94e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec31fbe-98eb-4f6b-a361-aaef905f1746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec31fbe-98eb-4f6b-a361-aaef905f1746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-843792070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdd7338-02f8-4aa2-bb27-39e4fd7a16de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e14808d5948168a0c8917d0f07f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:59Z,use_quota=True,user_id='c07730f5b2fa47159d739e4867ef42bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ece423-3b80-47d6-81d7-9d94a173a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ece423-3b80-47d6-81d7-9d94a173a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96924c5-b649-445d-991e-45890fcb6ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96924c5-b649-445d-991e-45890fcb6ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecdd7338-02f8-4aa2-bb27-39e4fd7a16de', 'volume_name': 'volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea65df4-66b8-4889-a51a-01b56b40ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea65df4-66b8-4889-a51a-01b56b40ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ec3064-75d6-44ee-a46f-5d48505ceae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:40:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Volume ecdd7338-02f8-4aa2-bb27-39e4fd7a16de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de', 'volume_size': 1}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-843792070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdd7338-02f8-4aa2-bb27-39e4fd7a16de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e14808d5948168a0c8917d0f07f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:40:59Z,use_quota=True,user_id='c07730f5b2fa47159d739e4867ef42bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Creating volume ecdd7338-02f8-4aa2-bb27-39e4fd7a16de {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:40:58 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:40:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:58 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de 1073741824
Jun 16 18:40:58 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:40:59 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Jun 16 18:40:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de 1073741824" returned: 0 in 0.919s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:40:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:40:59 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de
Jun 16 18:40:59 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:00 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de" returned: 0 in 0.800s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ec3064-75d6-44ee-a46f-5d48505ceae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3127932-9b8f-4a55-9702-1e467eed2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Volume volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de (ecdd7338-02f8-4aa2-bb27-39e4fd7a16de): created successfully
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3127932-9b8f-4a55-9702-1e467eed2260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Flow 'volume_create_manager' (20f44019-abc2-49fa-a204-3aebf1fe94e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4e489976-c3df-4e56-8df1-d31ab592026a tempest-AbsoluteLimitsTests-473966392 None] Created volume successfully.
Jun 16 18:41:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Acquiring lock "cinder-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Lock "cinder-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Acquiring lock "cinder-quobyte-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Lock "cinder-quobyte-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de" acquired by "delete_volume" :: waited 0.047s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[611204ad-caf9-41aa-9135-41b2dc8e42c9]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:01 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de
Jun 16 18:41:01 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:02 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de" returned: 0 in 1.253s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:02 devstack sudo[98607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de
Jun 16 18:41:02 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:03 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de" returned: 0 in 0.913s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Lock "cinder-quobyte-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de" released by "delete_volume" :: held 2.238s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=92,cinder:SELECT=77,cinder:INSERT=24,cinder:DELETE=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Created reservations ['6b0eb782-8526-4f19-89c1-47c20885fe86', '27b5530a-bcd2-4923-b703-dda6cd635ff9', 'c1750032-5051-44c0-b6e9-94fbe5f412f3', '8a1a9fec-cfab-44a3-a180-bb34888acabe'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:03 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:03 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:04 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.668s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:04 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Deleted volume successfully.
Jun 16 18:41:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9e244289-8842-4599-a5ef-c43369f62fb4 tempest-AbsoluteLimitsTests-473966392 None] Lock "cinder-ecdd7338-02f8-4aa2-bb27-39e4fd7a16de-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Flow 'volume_create_manager' (6480fd93-f853-44e2-a907-c6ec89441f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa27825-5cf1-41e6-8a4d-f58f8c374257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa27825-5cf1-41e6-8a4d-f58f8c374257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1448009889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31211c1a-0857-47b9-a7ce-37a12863fae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9d653bd3c540be9ba88c917daed517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:06Z,use_quota=True,user_id='d8d70f2f5bef4632a2d655e310c3446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed29d98-b94e-4a18-853f-ff55edc18b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed29d98-b94e-4a18-853f-ff55edc18b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073ea69f-3028-4ffc-8aab-0ee1ad5f3008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073ea69f-3028-4ffc-8aab-0ee1ad5f3008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31211c1a-0857-47b9-a7ce-37a12863fae8', 'volume_name': 'volume-31211c1a-0857-47b9-a7ce-37a12863fae8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6210ec41-06f1-4bb5-b020-2ee16fab6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6210ec41-06f1-4bb5-b020-2ee16fab6f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9220794-7cf4-4353-a141-7960b7db152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:06 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Volume 31211c1a-0857-47b9-a7ce-37a12863fae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31211c1a-0857-47b9-a7ce-37a12863fae8', 'volume_size': 1}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1448009889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31211c1a-0857-47b9-a7ce-37a12863fae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9d653bd3c540be9ba88c917daed517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:06Z,use_quota=True,user_id='d8d70f2f5bef4632a2d655e310c3446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Creating volume 31211c1a-0857-47b9-a7ce-37a12863fae8 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:06 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:06 devstack sudo[98653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8 1073741824
Jun 16 18:41:06 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:07 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8 1073741824" returned: 0 in 0.867s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:07 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8
Jun 16 18:41:07 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:08 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8" returned: 0 in 0.617s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9220794-7cf4-4353-a141-7960b7db152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31211c1a-0857-47b9-a7ce-37a12863fae8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab09c82-4dbc-47bc-8730-391a7e8ead38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Volume volume-31211c1a-0857-47b9-a7ce-37a12863fae8 (31211c1a-0857-47b9-a7ce-37a12863fae8): created successfully
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab09c82-4dbc-47bc-8730-391a7e8ead38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Flow 'volume_create_manager' (6480fd93-f853-44e2-a907-c6ec89441f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:08 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2f3fbcda-c88e-425b-90ac-a60e87b15a7a tempest-VolumesTransfersV355Test-1900875766 None] Created volume successfully.
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Flow 'volume_create_manager' (f138bba1-aeae-4d13-b09c-3acb79383bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05cebcb-daed-4544-aeea-31add45ea757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05cebcb-daed-4544-aeea-31add45ea757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1363961962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08eabbce-9273-42da-b9bb-7bf66a60a518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e205bb54a27042778ad4b15c6440dd95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:09Z,use_quota=True,user_id='66ec4ac5b8284e328fb87ab02d4bf043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e83ed40-b966-41f8-a2cb-519f238e3cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e83ed40-b966-41f8-a2cb-519f238e3cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8eab48-0b05-48fa-ac49-4f09651d811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8eab48-0b05-48fa-ac49-4f09651d811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08eabbce-9273-42da-b9bb-7bf66a60a518', 'volume_name': 'volume-08eabbce-9273-42da-b9bb-7bf66a60a518', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2147a806-14c2-48a1-b027-0b1519d0a465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2147a806-14c2-48a1-b027-0b1519d0a465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546e94d2-0176-43cf-b04c-7e8452f99f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:09 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Volume 08eabbce-9273-42da-b9bb-7bf66a60a518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08eabbce-9273-42da-b9bb-7bf66a60a518', 'volume_size': 1}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1363961962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08eabbce-9273-42da-b9bb-7bf66a60a518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e205bb54a27042778ad4b15c6440dd95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:09Z,use_quota=True,user_id='66ec4ac5b8284e328fb87ab02d4bf043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Creating volume 08eabbce-9273-42da-b9bb-7bf66a60a518 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:09 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:09 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518 1073741824
Jun 16 18:41:09 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:09 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e5adbbd5-0166-46c3-a024-aa0b3c9b3459 tempest-VolumesTransfersV355Test-1104077814 None] Transfer volume completed successfully.
Jun 16 18:41:10 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518 1073741824" returned: 0 in 1.201s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:10 devstack sudo[98738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518
Jun 16 18:41:10 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Acquiring lock "cinder-31211c1a-0857-47b9-a7ce-37a12863fae8-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-31211c1a-0857-47b9-a7ce-37a12863fae8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Acquiring lock "cinder-quobyte-31211c1a-0857-47b9-a7ce-37a12863fae8" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-quobyte-31211c1a-0857-47b9-a7ce-37a12863fae8" acquired by "delete_volume" :: waited 0.047s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd33f28b-e4d1-488a-ac0e-3d67ad76d419]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:11 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518" returned: 0 in 1.154s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546e94d2-0176-43cf-b04c-7e8452f99f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08eabbce-9273-42da-b9bb-7bf66a60a518', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf9f318-94d9-49dd-9d22-87ca854e0d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:11 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Volume volume-08eabbce-9273-42da-b9bb-7bf66a60a518 (08eabbce-9273-42da-b9bb-7bf66a60a518): created successfully
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf9f318-94d9-49dd-9d22-87ca854e0d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Flow 'volume_create_manager' (f138bba1-aeae-4d13-b09c-3acb79383bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:11 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a0e1c307-7eda-4d4a-b9b7-1ac3033d5eb8 tempest-VolumesMetadataTest-1556890406 None] Created volume successfully.
Jun 16 18:41:11 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8
Jun 16 18:41:11 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:12 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8" returned: 0 in 0.862s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:12 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8
Jun 16 18:41:12 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:13 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-31211c1a-0857-47b9-a7ce-37a12863fae8" returned: 0 in 0.765s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-quobyte-31211c1a-0857-47b9-a7ce-37a12863fae8" released by "delete_volume" :: held 1.697s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Created reservations ['8a3a0e40-5a20-4584-982a-6f7d09a119d4', 'b36221b9-0890-4bfe-85e6-59e4c029e08d', '49fe431b-8189-4004-8dd0-4889adf7c152', '5bd49ac0-c277-4831-84a9-696a7a878fe4'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:13 devstack sudo[98753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:13 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Acquiring lock "cinder-08eabbce-9273-42da-b9bb-7bf66a60a518-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Lock "cinder-08eabbce-9273-42da-b9bb-7bf66a60a518-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=99,cinder:INSERT=25,cinder:SELECT=75,cinder:DELETE=9 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Acquiring lock "cinder-quobyte-08eabbce-9273-42da-b9bb-7bf66a60a518" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Lock "cinder-quobyte-08eabbce-9273-42da-b9bb-7bf66a60a518" acquired by "delete_volume" :: waited 0.030s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4f6e6-f412-4078-8a19-2c0719aa9561]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:14 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518
Jun 16 18:41:14 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:14 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.016s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Flow 'volume_create_manager' (f74e40e2-86be-401d-8155-5b7e6d900f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f07d3be-c3be-46e6-ac19-3d0f58603650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Deleted volume successfully.
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f07d3be-c3be-46e6-ac19-3d0f58603650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-15011677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9d653bd3c540be9ba88c917daed517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:14Z,use_quota=True,user_id='d8d70f2f5bef4632a2d655e310c3446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4d695c-6f56-4ea1-b4d2-d352aa1be0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4d695c-6f56-4ea1-b4d2-d352aa1be0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c938a53d-9dd6-4753-a810-415c2cab9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c938a53d-9dd6-4753-a810-415c2cab9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172', 'volume_name': 'volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd2a9ad-2bcc-4c55-8ab7-a991561a3289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd2a9ad-2bcc-4c55-8ab7-a991561a3289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cb5ceb-7e03-4fe3-82f8-a8bedf170f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:14 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Volume 535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172', 'volume_size': 1}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-15011677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9d653bd3c540be9ba88c917daed517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:14Z,use_quota=True,user_id='d8d70f2f5bef4632a2d655e310c3446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Creating volume 535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:14 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a4429182-7d7d-4a70-b31d-b704b29d7646 tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-31211c1a-0857-47b9-a7ce-37a12863fae8-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:14 devstack sudo[98758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 1073741824
Jun 16 18:41:14 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:15 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518" returned: 0 in 1.374s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:15 devstack sudo[98763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518
Jun 16 18:41:15 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-27c41b50-ea2f-472a-adf7-81f248484cc4 req-f6bad88c-0082-48e3-952b-0cf0beddfd16 tempest-AttachVolumeTestJSON-1918294011 None] Terminate volume connection completed successfully.
Jun 16 18:41:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-27c41b50-ea2f-472a-adf7-81f248484cc4 req-f6bad88c-0082-48e3-952b-0cf0beddfd16 tempest-AttachVolumeTestJSON-1918294011 None] Deleting attachment 5eb9e914-675d-4ca0-b778-b9c3aafc9698. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:41:15 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 1073741824" returned: 0 in 1.208s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:15 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172
Jun 16 18:41:15 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:15 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-08eabbce-9273-42da-b9bb-7bf66a60a518" returned: 0 in 0.930s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Lock "cinder-quobyte-08eabbce-9273-42da-b9bb-7bf66a60a518" released by "delete_volume" :: held 2.387s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Created reservations ['5a5ed2b8-1764-4caf-a135-3673989a60c9', '2baa5cab-35cc-43c2-9d89-6ceffadc58d8', 'c454f8fd-9508-4f22-bb40-607c8b9de0ed', '14665022-9122-4765-acf9-193d43a4e9c6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:16 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:16 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:16 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172" returned: 0 in 0.916s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cb5ceb-7e03-4fe3-82f8-a8bedf170f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598d346c-ab70-4b4d-bbc3-dc9caa4387b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:16 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Volume volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 (535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172): created successfully
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598d346c-ab70-4b4d-bbc3-dc9caa4387b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Flow 'volume_create_manager' (f74e40e2-86be-401d-8155-5b7e6d900f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6194ed8b-1de0-437a-92df-a27f2a510c37 tempest-VolumesTransfersV355Test-1900875766 None] Created volume successfully.
Jun 16 18:41:17 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:17 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:17 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Deleted volume successfully.
Jun 16 18:41:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3a3f0ed0-804c-4550-b000-aace8efcd1c3 tempest-VolumesMetadataTest-1556890406 None] Lock "cinder-08eabbce-9273-42da-b9bb-7bf66a60a518-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Acquiring lock "cinder-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Acquiring lock "cinder-quobyte-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-quobyte-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172" acquired by "delete_volume" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:18 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[59460c77-44bc-4a04-bd8f-8d6e16d73faf]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:18 devstack sudo[98782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172
Jun 16 18:41:18 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:19 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172" returned: 0 in 1.275s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:19 devstack sudo[98823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172
Jun 16 18:41:19 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:20 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172" returned: 0 in 0.810s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-quobyte-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172" released by "delete_volume" :: held 2.140s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Created reservations ['6debf9e3-db5a-443e-a3ec-126c8c22689e', '4b7ad8c7-4fdd-45a6-b926-0d7e7c700c9e', '52a8aad1-77cb-430a-ae3a-c666588d5626', 'aee41cea-8ad1-47c7-b1e9-fa4a10346f6b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:20 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:20 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:21 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:21 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Deleted volume successfully.
Jun 16 18:41:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e742d420-d972-41c0-b1e5-b1c38f304dcc tempest-VolumesTransfersV355Test-1862963733 None] Lock "cinder-535e2d7b-1d0e-4ec3-94b3-d6ecb19ef172-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Flow 'volume_create_manager' (ae8d3369-02ea-488b-9d88-121bc6bc9065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fbee09-55bd-45ba-b3eb-575d7319bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fbee09-55bd-45ba-b3eb-575d7319bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1006982868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b6961b-5314-4368-85a5-be9121b48015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1279e557dc481bbf4a04cc284dcbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:23Z,use_quota=True,user_id='f2442ad85d79417a90caa9c1e59866c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e4fbea-86cc-446c-a832-1fb247a8ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e4fbea-86cc-446c-a832-1fb247a8ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3ab433-21b6-4007-b576-e389a2888668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3ab433-21b6-4007-b576-e389a2888668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b6961b-5314-4368-85a5-be9121b48015', 'volume_name': 'volume-b8b6961b-5314-4368-85a5-be9121b48015', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148c3988-ea8b-47da-8118-6d7d7f94983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148c3988-ea8b-47da-8118-6d7d7f94983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a18e968-5fef-4b38-a8b1-f6e0fc3a395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:22 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Volume b8b6961b-5314-4368-85a5-be9121b48015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b6961b-5314-4368-85a5-be9121b48015', 'volume_size': 1}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1006982868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b6961b-5314-4368-85a5-be9121b48015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1279e557dc481bbf4a04cc284dcbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:23Z,use_quota=True,user_id='f2442ad85d79417a90caa9c1e59866c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Creating volume b8b6961b-5314-4368-85a5-be9121b48015 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:22 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:22 devstack sudo[98856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015 1073741824
Jun 16 18:41:22 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:23 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015 1073741824" returned: 0 in 0.896s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:23 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015
Jun 16 18:41:23 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:24 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a18e968-5fef-4b38-a8b1-f6e0fc3a395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b6961b-5314-4368-85a5-be9121b48015', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eb43ff-7b9e-4943-9ff2-e65868aadc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:24 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Volume volume-b8b6961b-5314-4368-85a5-be9121b48015 (b8b6961b-5314-4368-85a5-be9121b48015): created successfully
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eb43ff-7b9e-4943-9ff2-e65868aadc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Flow 'volume_create_manager' (ae8d3369-02ea-488b-9d88-121bc6bc9065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:24 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e601eae9-87a7-4cb9-8b2e-dfc4ff76edb6 tempest-VolumesTransfersV357Test-443746442 None] Created volume successfully.
Jun 16 18:41:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-06181cf4-3a1d-4524-bc85-e944da8cfac9 tempest-VolumesTransfersV357Test-1002330507 None] Transfer volume completed successfully.
Jun 16 18:41:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Acquiring lock "cinder-b8b6961b-5314-4368-85a5-be9121b48015-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-b8b6961b-5314-4368-85a5-be9121b48015-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Acquiring lock "cinder-quobyte-b8b6961b-5314-4368-85a5-be9121b48015" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-quobyte-b8b6961b-5314-4368-85a5-be9121b48015" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4be0c-bded-4d5d-ba5c-ed629d7a8942]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:27 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015
Jun 16 18:41:27 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Flow 'volume_create_manager' (16adfc4a-f8a1-4232-aa48-4fadb73d16d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33fa3a1-91d7-4859-8bd2-193e5d6197a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33fa3a1-91d7-4859-8bd2-193e5d6197a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-446477406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ceb010-ebeb-4444-9062-df22b8db503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bba089c99944c01b53011532cefebef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:27Z,use_quota=True,user_id='7fd866f727b540c48c424730f22988a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f3c32f-113e-45de-860c-70267cd79302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f3c32f-113e-45de-860c-70267cd79302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfcaf89-2dc6-406e-a225-05e1e3b727d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfcaf89-2dc6-406e-a225-05e1e3b727d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ceb010-ebeb-4444-9062-df22b8db503e', 'volume_name': 'volume-e4ceb010-ebeb-4444-9062-df22b8db503e', 'volume_size': 2}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3e264c-8b0a-47e6-a663-671f431805b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3e264c-8b0a-47e6-a663-671f431805b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79045d63-76e0-4301-9232-bb92fc36a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:27 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Volume e4ceb010-ebeb-4444-9062-df22b8db503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ceb010-ebeb-4444-9062-df22b8db503e', 'volume_size': 2}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-446477406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ceb010-ebeb-4444-9062-df22b8db503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bba089c99944c01b53011532cefebef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:27Z,use_quota=True,user_id='7fd866f727b540c48c424730f22988a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Creating volume e4ceb010-ebeb-4444-9062-df22b8db503e {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:27 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e 2147483648 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:27 devstack sudo[98919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e 2147483648
Jun 16 18:41:27 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:27 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015" returned: 0 in 0.766s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:27 devstack sudo[98925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015
Jun 16 18:41:27 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:28 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b8b6961b-5314-4368-85a5-be9121b48015" returned: 0 in 1.274s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:29 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-quobyte-b8b6961b-5314-4368-85a5-be9121b48015" released by "delete_volume" :: held 2.105s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e 2147483648" returned: 0 in 1.431s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Created reservations ['0b5524d4-4c5d-4291-b804-64eb29a00afd', 'd41577b8-1b0f-4891-bd2f-64270deafdbc', 'bac9b224-90c8-4e36-9369-9fa999695e78', 'e704bd28-d813-4dc3-9de8-ed9cf094a6ed'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:29 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e
Jun 16 18:41:29 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:29 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:29 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:29 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Flow 'volume_create_manager' (99cd36cd-c2a7-45e7-939c-01825314e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2fd95c-8c75-4ab8-bf43-6ef560c65d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2fd95c-8c75-4ab8-bf43-6ef560c65d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1117207330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae01dae-a2ff-4248-9d27-dd5f86fb3839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1279e557dc481bbf4a04cc284dcbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:30Z,use_quota=True,user_id='f2442ad85d79417a90caa9c1e59866c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a364b716-75fc-4733-a21a-90108ff535fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a364b716-75fc-4733-a21a-90108ff535fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c328ff42-b026-4fb5-b494-c16cb508c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c328ff42-b026-4fb5-b494-c16cb508c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae01dae-a2ff-4248-9d27-dd5f86fb3839', 'volume_name': 'volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8771802a-ba1b-4eac-b20e-3a251ab4c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8771802a-ba1b-4eac-b20e-3a251ab4c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6b1436-c3fa-44e4-a293-d71775008a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:30 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Volume 9ae01dae-a2ff-4248-9d27-dd5f86fb3839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839', 'volume_size': 1}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:30 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.052s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Deleted volume successfully.
Jun 16 18:41:30 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e" returned: 0 in 1.219s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] <== create_volume: return (2714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.717s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-67e802ff-1295-48e2-bded-0b3819103e50 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-b8b6961b-5314-4368-85a5-be9121b48015-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1117207330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae01dae-a2ff-4248-9d27-dd5f86fb3839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1279e557dc481bbf4a04cc284dcbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:30Z,use_quota=True,user_id='f2442ad85d79417a90caa9c1e59866c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Creating volume 9ae01dae-a2ff-4248-9d27-dd5f86fb3839 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:30 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79045d63-76e0-4301-9232-bb92fc36a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ceb010-ebeb-4444-9062-df22b8db503e', 'volume_size': 2}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32a111a-2e58-4215-a86d-7ea7503bba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:30 devstack sudo[99002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 1073741824
Jun 16 18:41:30 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:30 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Volume volume-e4ceb010-ebeb-4444-9062-df22b8db503e (e4ceb010-ebeb-4444-9062-df22b8db503e): created successfully
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32a111a-2e58-4215-a86d-7ea7503bba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Flow 'volume_create_manager' (16adfc4a-f8a1-4232-aa48-4fadb73d16d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a6dff8af-7764-4873-92b2-a8a70b8ce2d1 tempest-VolumesCloneNegativeTest-1069579223 None] Created volume successfully.
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Acquiring lock "cinder-e4ceb010-ebeb-4444-9062-df22b8db503e-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "cinder-e4ceb010-ebeb-4444-9062-df22b8db503e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Acquiring lock "cinder-quobyte-e4ceb010-ebeb-4444-9062-df22b8db503e" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "cinder-quobyte-e4ceb010-ebeb-4444-9062-df22b8db503e" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d80c8fb-6c59-4407-a337-8008a94a3e65]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:31 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e
Jun 16 18:41:31 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:31 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 1073741824" returned: 0 in 1.183s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:31 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839
Jun 16 18:41:31 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:32 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e" returned: 0 in 0.921s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:32 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e
Jun 16 18:41:32 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:32 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839" returned: 0 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6b1436-c3fa-44e4-a293-d71775008a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd69444-fdfa-4e90-a129-841c6954910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:32 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Volume volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 (9ae01dae-a2ff-4248-9d27-dd5f86fb3839): created successfully
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd69444-fdfa-4e90-a129-841c6954910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Flow 'volume_create_manager' (99cd36cd-c2a7-45e7-939c-01825314e998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:32 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5adc9bbb-ec74-4cd7-b22f-10e8ef67ccb3 tempest-VolumesTransfersV357Test-443746442 None] Created volume successfully.
Jun 16 18:41:32 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e4ceb010-ebeb-4444-9062-df22b8db503e" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "cinder-quobyte-e4ceb010-ebeb-4444-9062-df22b8db503e" released by "delete_volume" :: held 1.578s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Created reservations ['e4b72880-528a-427f-94e5-b1423e19ad4d', 'b3b0de19-a242-4a33-bd06-3060ee1320f3', 'dbad2a24-d586-4626-a457-21e5877ebb49', '9d1d6209-abdc-480b-b2d2-8d5f3bba49b7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:32 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:32 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Acquiring lock "cinder-9ae01dae-a2ff-4248-9d27-dd5f86fb3839-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-9ae01dae-a2ff-4248-9d27-dd5f86fb3839-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Acquiring lock "cinder-quobyte-9ae01dae-a2ff-4248-9d27-dd5f86fb3839" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-quobyte-9ae01dae-a2ff-4248-9d27-dd5f86fb3839" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e10d3b-ca08-4cb0-aace-62922e7af9c4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:33 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.708s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Deleted volume successfully.
Jun 16 18:41:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2ce11dca-bb5d-43a6-b1b2-38fe1ad49047 tempest-VolumesCloneNegativeTest-1069579223 None] Lock "cinder-e4ceb010-ebeb-4444-9062-df22b8db503e-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:33 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839
Jun 16 18:41:33 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:34 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839" returned: 0 in 0.789s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:34 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839
Jun 16 18:41:34 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:35 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9ae01dae-a2ff-4248-9d27-dd5f86fb3839" returned: 0 in 0.770s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-quobyte-9ae01dae-a2ff-4248-9d27-dd5f86fb3839" released by "delete_volume" :: held 1.624s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Created reservations ['6964c763-51d8-49ba-9b42-032929de83e7', '903066af-d347-4c2e-80e5-296881b3e7d9', 'b3e51984-a724-4766-9097-5aac2f98f032', '6bfa8f30-f9c7-4b3e-a1be-ff3bbfbde7b5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:35 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:35 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:36 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.771s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Deleted volume successfully.
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11ba0408-367f-4537-863d-4f88a0358b07 tempest-VolumesTransfersV357Test-830730450 None] Lock "cinder-9ae01dae-a2ff-4248-9d27-dd5f86fb3839-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Flow 'volume_create_manager' (3021cea0-58ee-488a-9bff-774f8e426e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86027ce-06b9-4c40-a598-9a19a02c1a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86027ce-06b9-4c40-a598-9a19a02c1a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1948974818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f295bf60-7c41-4ba3-a883-a2df8d2d0629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd9422348164525877ba36a3d76d1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:36Z,use_quota=True,user_id='8002323fc7734371b7cc3bf373b5ea51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450422e9-859a-4110-b61a-0061731cf430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450422e9-859a-4110-b61a-0061731cf430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915121df-078f-404d-a927-141f7ae15ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915121df-078f-404d-a927-141f7ae15ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f295bf60-7c41-4ba3-a883-a2df8d2d0629', 'volume_name': 'volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7e4bcb-8230-4aa8-ac5d-3064d5d2f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7e4bcb-8230-4aa8-ac5d-3064d5d2f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9094f1-c09d-4110-a212-aee952a87ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:36 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Volume f295bf60-7c41-4ba3-a883-a2df8d2d0629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629', 'volume_size': 1}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1948974818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f295bf60-7c41-4ba3-a883-a2df8d2d0629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd9422348164525877ba36a3d76d1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:36Z,use_quota=True,user_id='8002323fc7734371b7cc3bf373b5ea51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Creating volume f295bf60-7c41-4ba3-a883-a2df8d2d0629 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:36 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:36 devstack sudo[99036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 1073741824
Jun 16 18:41:36 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:37 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 1073741824" returned: 0 in 1.230s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:37 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629
Jun 16 18:41:37 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Flow 'volume_create_manager' (49ef2186-203b-4186-b77f-faba9be0829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6989ac0-a823-4b35-bb9b-ed0c71869a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6989ac0-a823-4b35-bb9b-ed0c71869a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530416659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a968a6-0627-43ec-86f2-898a2f262bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db81261a83f44f7badcd0bd04f917afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:38Z,use_quota=True,user_id='691668fb9ea14f2f90dcc4fcf1177789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639cbba8-8e9f-4628-8102-cd0dd0f0a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639cbba8-8e9f-4628-8102-cd0dd0f0a58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8aa0ee-16ea-4e0c-ada6-6e898d0e7263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:41:38 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629" returned: 0 in 0.863s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9094f1-c09d-4110-a212-aee952a87ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996a016-c5ba-45f9-9477-e971d1d9d041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:38 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Volume volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 (f295bf60-7c41-4ba3-a883-a2df8d2d0629): created successfully
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996a016-c5ba-45f9-9477-e971d1d9d041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Flow 'volume_create_manager' (3021cea0-58ee-488a-9bff-774f8e426e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:38 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fe003432-34cc-4c4e-bbd9-196f4db4d163 tempest-AttachVolumeShelveTestJSON-917558730 None] Created volume successfully.
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8aa0ee-16ea-4e0c-ada6-6e898d0e7263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10a968a6-0627-43ec-86f2-898a2f262bfd', 'volume_name': 'volume-10a968a6-0627-43ec-86f2-898a2f262bfd', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b966de0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5af8027-69a5-45ea-a893-895a33964597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5af8027-69a5-45ea-a893-895a33964597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ad5a45-cc50-43ac-ad65-cbc410cde10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Volume 10a968a6-0627-43ec-86f2-898a2f262bfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10a968a6-0627-43ec-86f2-898a2f262bfd', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b966de0>}
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Trying to clone 10a968a6-0627-43ec-86f2-898a2f262bfd from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:41:39 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Image download 20.69 MB at 20.69 MB/s
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f448574a-6c31-48f6-a46c-85f7b76482ad]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:39 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD
Jun 16 18:41:39 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:40 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD" returned: 0 in 0.826s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:40 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d is fetched for user 691668fb9ea14f2f90dcc4fcf1177789. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:41:40 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b28f5b-6c41-4d6d-b135-e95dd242349e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:40 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD
Jun 16 18:41:40 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:41 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD" returned: 0 in 0.959s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-530416659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a968a6-0627-43ec-86f2-898a2f262bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db81261a83f44f7badcd0bd04f917afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:38Z,use_quota=True,user_id='691668fb9ea14f2f90dcc4fcf1177789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Creating volume 10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:41 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:41 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 1073741824
Jun 16 18:41:41 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:42 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:42 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:42 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 1073741824" returned: 0 in 0.948s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:42 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:42 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:42 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.687s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:41:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:41:43 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 0 in 0.915s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:43 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Attempting download of 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume 10a968a6-0627-43ec-86f2-898a2f262bfd. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:41:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e23fc-a48b-41c0-a775-4b48d7569a6b]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:43 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o
Jun 16 18:41:43 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:44 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o" returned: 0 in 0.738s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:44 devstack sudo[99141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o
Jun 16 18:41:44 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:45 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o" returned: 1 in 0.686s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_oiitdi_o' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebe191d-dfb5-44ea-890c-c6ef1b3d14f4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:45 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD
Jun 16 18:41:45 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:45 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD" returned: 0 in 0.858s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d was qcow2, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:41:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:46 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:46 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Flow 'volume_create_manager' (97c1a9cb-a595-4048-a1de-75ae953d7552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf3c604-5564-405f-8274-73c11be07d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf3c604-5564-405f-8274-73c11be07d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1677442664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d40b9d1-16ad-4370-a5fb-edf66767f1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbef78035f54dfb942d57073a8ea7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:46Z,use_quota=True,user_id='4af4e21f148a421fad4517cdfe8ec0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebc0784-448b-41d5-bd93-74e1b993f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebc0784-448b-41d5-bd93-74e1b993f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6195450-204f-420b-93c9-2f80da8d0c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6195450-204f-420b-93c9-2f80da8d0c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d40b9d1-16ad-4370-a5fb-edf66767f1b7', 'volume_name': 'volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96bbb55-1ecd-4c77-a35a-f9122419f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96bbb55-1ecd-4c77-a35a-f9122419f1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976f23ea-b0f0-4cb0-b21e-458e7612855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:46 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Volume 4d40b9d1-16ad-4370-a5fb-edf66767f1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7', 'volume_size': 1}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1677442664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d40b9d1-16ad-4370-a5fb-edf66767f1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbef78035f54dfb942d57073a8ea7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:46Z,use_quota=True,user_id='4af4e21f148a421fad4517cdfe8ec0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Creating volume 4d40b9d1-16ad-4370-a5fb-edf66767f1b7 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:46 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:46 devstack sudo[99172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 1073741824
Jun 16 18:41:46 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:47 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 1073741824" returned: 0 in 1.028s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:47 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7
Jun 16 18:41:47 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:48 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 0 in 2.416s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_49wxvpg2devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:41:48 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Converted 112.00 MB image at 46.33 MB/s
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:48 devstack sudo[99189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 1G
Jun 16 18:41:48 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:48 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7" returned: 0 in 0.946s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976f23ea-b0f0-4cb0-b21e-458e7612855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1614eee6-cada-45c6-b4c0-da2b9e6f4e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Volume volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 (4d40b9d1-16ad-4370-a5fb-edf66767f1b7): created successfully
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1614eee6-cada-45c6-b4c0-da2b9e6f4e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Flow 'volume_create_manager' (97c1a9cb-a595-4048-a1de-75ae953d7552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-bc102907-aa8a-44db-a308-f0b640d45fe0 tempest-VolumesNegativeTest-537522617 None] Created volume successfully.
Jun 16 18:41:49 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 1G" returned: 0 in 0.922s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded6ee4-b02b-490a-ab62-41cfdb8607fd]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:49 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:49 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:50 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 0 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:50 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:50 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:50 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 1 in 0.721s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Downloaded image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume 10a968a6-0627-43ec-86f2-898a2f262bfd successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d for user 691668fb9ea14f2f90dcc4fcf1177789 is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Marking volume 10a968a6-0627-43ec-86f2-898a2f262bfd as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Copying metadata from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d to 10a968a6-0627-43ec-86f2-898a2f262bfd. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Creating volume glance metadata for volume 10a968a6-0627-43ec-86f2-898a2f262bfd backed by image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ad5a45-cc50-43ac-ad65-cbc410cde10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a968a6-0627-43ec-86f2-898a2f262bfd', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b966de0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedfb126-a8bb-499a-a99d-f05fbf608dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:50 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Volume volume-10a968a6-0627-43ec-86f2-898a2f262bfd (10a968a6-0627-43ec-86f2-898a2f262bfd): created successfully
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedfb126-a8bb-499a-a99d-f05fbf608dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Flow 'volume_create_manager' (49ef2186-203b-4186-b77f-faba9be0829f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-66d4412d-907b-48dd-b678-e2a3386a067c tempest-VolumesExtendTest-34768082 None] Created volume successfully.
Jun 16 18:41:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[05825691-1d17-4bff-9bdf-55ab089c350c]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:51 devstack sudo[99210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:51 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:52 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 0 in 0.726s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:52 devstack sudo[99214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:52 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:53 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 1 in 1.000s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 2G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd 2G" returned: 0 in 0.079s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.866s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a20b6508-0f76-42fd-a6ee-34281e0b952a tempest-VolumesExtendTest-34768082 None] Extend volume completed successfully.
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-10a968a6-0627-43ec-86f2-898a2f262bfd-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Lock "cinder-10a968a6-0627-43ec-86f2-898a2f262bfd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-quobyte-10a968a6-0627-43ec-86f2-898a2f262bfd" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:41:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-10a968a6-0627-43ec-86f2-898a2f262bfd" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:41:54 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f749587-3bc7-4df0-a265-a29a1d5fa9c8]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:41:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:54 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:54 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:54 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 0 in 0.800s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:55 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:55 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:55 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 1 in 0.917s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:41:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:55 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd
Jun 16 18:41:55 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-16e9bfda-0999-47c4-ab45-5e8f695c75ff req-5c1852e8-c6b1-46a5-bc85-cb1af91dfcc5 tempest-AttachVolumeShelveTestJSON-917558730 None] No connector for attachment da5b62de-77b5-48e2-9f33-b159df9d16c2; skipping storage backend terminate_connection call. {{(pid=91851) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-16e9bfda-0999-47c4-ab45-5e8f695c75ff req-5c1852e8-c6b1-46a5-bc85-cb1af91dfcc5 tempest-AttachVolumeShelveTestJSON-917558730 None] Deleting attachment da5b62de-77b5-48e2-9f33-b159df9d16c2. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:41:56 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10a968a6-0627-43ec-86f2-898a2f262bfd" returned: 0 in 0.784s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-10a968a6-0627-43ec-86f2-898a2f262bfd" released by "delete_volume" :: held 2.589s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Created reservations ['98192a98-9555-4496-8e1a-d53f71336c26', '5b789220-4e6e-4471-ba5b-a7437eec0760', '57cc8004-c84a-4839-a188-5c8ec794a8b1', '92dc44d6-f987-43ee-8f3b-38ebdad05775'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:56 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:41:56 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:57 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.030s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:41:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Deleted volume successfully.
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82cec0d0-17b7-4ab5-af54-a448392950f2 tempest-VolumesExtendTest-34768082 None] Lock "cinder-10a968a6-0627-43ec-86f2-898a2f262bfd-delete_volume" released by "delete_volume" :: held 3.923s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Flow 'volume_create_manager' (91b609f3-439d-4dfe-8b63-4436efefdd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61277a07-33c3-4f07-9bb3-174e7a58f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61277a07-33c3-4f07-9bb3-174e7a58f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1602145155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4241420d-17eb-4e85-b7cf-c7b29dbe875d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db81261a83f44f7badcd0bd04f917afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:58Z,use_quota=True,user_id='691668fb9ea14f2f90dcc4fcf1177789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541d24bf-dd52-4131-b30c-80652b55b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541d24bf-dd52-4131-b30c-80652b55b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def4345b-6243-44ad-bac5-60dcef1e8860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def4345b-6243-44ad-bac5-60dcef1e8860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4241420d-17eb-4e85-b7cf-c7b29dbe875d', 'volume_name': 'volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b87cfe8-ecb3-428a-86ad-c2f9923618a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b87cfe8-ecb3-428a-86ad-c2f9923618a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd39e764-c29b-460d-bf7e-bf24c002c194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Volume 4241420d-17eb-4e85-b7cf-c7b29dbe875d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d', 'volume_size': 1}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1602145155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4241420d-17eb-4e85-b7cf-c7b29dbe875d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db81261a83f44f7badcd0bd04f917afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:41:58Z,use_quota=True,user_id='691668fb9ea14f2f90dcc4fcf1177789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Creating volume 4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:41:58 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:58 devstack sudo[99306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d 1073741824
Jun 16 18:41:58 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:58 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d 1073741824" returned: 0 in 0.868s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:41:58 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d
Jun 16 18:41:58 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:41:59 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d" returned: 0 in 0.638s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd39e764-c29b-460d-bf7e-bf24c002c194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8477b464-a3bc-4c6f-b5d6-de0242b86543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:41:59 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Volume volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d (4241420d-17eb-4e85-b7cf-c7b29dbe875d): created successfully
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8477b464-a3bc-4c6f-b5d6-de0242b86543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:41:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Flow 'volume_create_manager' (91b609f3-439d-4dfe-8b63-4436efefdd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:41:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ceb02529-c530-43ff-b190-c157e2fdbefc tempest-VolumesExtendTest-34768082 None] Created volume successfully.
Jun 16 18:42:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Creating offline snapshot 724f472d-d3b8-4bde-9810-3ba2d2291c6a of volume 4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:42:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784f82b-2bd6-4946-96dd-7bd1a689999e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:00 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d
Jun 16 18:42:00 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:01 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d" returned: 0 in 0.825s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:01 devstack sudo[99324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a 1G
Jun 16 18:42:01 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:01 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a 1G" returned: 0 in 0.843s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:02 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a
Jun 16 18:42:02 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:02 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a" returned: 0 in 0.683s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:02 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a is being set with open permissions: ugo+rw
Jun 16 18:42:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:02 devstack sudo[99339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a
Jun 16 18:42:02 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:03 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a" returned: 0 in 1.114s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:03 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=93,cinder:DELETE=5,cinder:SELECT=77,cinder:INSERT=24 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:42:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:03 devstack sudo[99399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info
Jun 16 18:42:03 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:04 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info" returned: 0 in 0.852s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:04 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info is being set with open permissions: ugo+rw
Jun 16 18:42:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:04 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info
Jun 16 18:42:04 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:05 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.info" returned: 0 in 0.881s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2e319d19-dda2-4695-af3c-55325ca608a8 tempest-VolumesExtendTest-34768082 None] Create snapshot completed successfully
Jun 16 18:42:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:06 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e381854-06d3-4808-83ba-9bd7fe624428]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:07 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d
Jun 16 18:42:07 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:07 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d" returned: 0 in 0.861s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a 2G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a 2G" returned: 0 in 0.110s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:07 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8e847981-f18e-420f-b2b7-906051da145e tempest-VolumesExtendTest-34768082 None] Extend volume completed successfully.
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-724f472d-d3b8-4bde-9810-3ba2d2291c6a-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Lock "cinder-724f472d-d3b8-4bde-9810-3ba2d2291c6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-quobyte-4241420d-17eb-4e85-b7cf-c7b29dbe875d" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-4241420d-17eb-4e85-b7cf-c7b29dbe875d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-quobyte-724f472d-d3b8-4bde-9810-3ba2d2291c6a" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-724f472d-d3b8-4bde-9810-3ba2d2291c6a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Deleting offline snapshot 724f472d-d3b8-4bde-9810-3ba2d2291c6a of volume 4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] snapshot_file for this snap is: volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70d2524-06d4-40f7-a41a-290a7f25fb37]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:08 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a
Jun 16 18:42:08 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:09 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a" returned: 0 in 0.985s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:42:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ed757-400d-45fb-8858-1d07d8b186db]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:09 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d
Jun 16 18:42:09 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:10 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d" returned: 0 in 0.811s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:10 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a
Jun 16 18:42:10 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:11 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a" returned: 0 in 1.027s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:11 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a
Jun 16 18:42:11 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:12 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d.724f472d-d3b8-4bde-9810-3ba2d2291c6a" returned: 0 in 0.857s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-724f472d-d3b8-4bde-9810-3ba2d2291c6a" released by "_delete_snapshot" :: held 3.845s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-4241420d-17eb-4e85-b7cf-c7b29dbe875d" released by "delete_snapshot" :: held 3.888s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Created reservations ['e7c1120b-f1a9-4875-adaa-301b6507008a', 'b9a7ec16-c816-4520-ba29-1c4567d59b2c', '5115d64b-ebad-4dcc-9010-1c2069cd5efd', '3ca0ef43-8378-4390-a31d-710c09a076cb'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Delete snapshot completed successfully.
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0e4290c-7116-49d8-ae31-40d0ac489466 tempest-VolumesExtendTest-34768082 None] Lock "cinder-724f472d-d3b8-4bde-9810-3ba2d2291c6a-delete_snapshot" released by "delete_snapshot" :: held 4.078s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-4241420d-17eb-4e85-b7cf-c7b29dbe875d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Lock "cinder-4241420d-17eb-4e85-b7cf-c7b29dbe875d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Acquiring lock "cinder-quobyte-4241420d-17eb-4e85-b7cf-c7b29dbe875d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-4241420d-17eb-4e85-b7cf-c7b29dbe875d" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffa9872-64c9-4bf4-8e30-00051596aed4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:13 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d
Jun 16 18:42:13 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:13 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d" returned: 0 in 0.927s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:13 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d
Jun 16 18:42:13 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:14 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4241420d-17eb-4e85-b7cf-c7b29dbe875d" returned: 0 in 0.628s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Lock "cinder-quobyte-4241420d-17eb-4e85-b7cf-c7b29dbe875d" released by "delete_volume" :: held 1.666s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=64,cinder:DELETE=13,cinder:UPDATE=89,cinder:INSERT=25 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Created reservations ['6bbf1b23-41e2-4f59-9289-ae7cb8af3c09', 'adcfb4fc-379f-4a6d-911a-d4ce4920403d', 'fbec039e-349e-4680-b01c-cce1fd7636a3', 'd2fc8d8d-0fc1-4d16-866f-61379fae5ed1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:14 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:14 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:15 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:15 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Deleted volume successfully.
Jun 16 18:42:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1e840021-6130-45da-883c-224f22b207cd tempest-VolumesExtendTest-34768082 None] Lock "cinder-4241420d-17eb-4e85-b7cf-c7b29dbe875d-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (69f1bb17-e0f1-43df-ba4e-d62ecee68519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7423a23-732c-4a8f-98ea-695b86cecdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7423a23-732c-4a8f-98ea-695b86cecdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86949022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a9f216-1234-4de8-ae74-8f43f574cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:21Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11a2505-7f8e-485c-bb30-dbd36a07ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11a2505-7f8e-485c-bb30-dbd36a07ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67ca785-0e5a-49dc-b0ad-34abd6db55a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67ca785-0e5a-49dc-b0ad-34abd6db55a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a9f216-1234-4de8-ae74-8f43f574cf3c', 'volume_name': 'volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3de8d24-cf7d-40df-8c41-43b4679438fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3de8d24-cf7d-40df-8c41-43b4679438fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799dddcc-2137-4c17-96de-0170275eeb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:20 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume e3a9f216-1234-4de8-ae74-8f43f574cf3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c', 'volume_size': 1}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86949022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a9f216-1234-4de8-ae74-8f43f574cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:21Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Creating volume e3a9f216-1234-4de8-ae74-8f43f574cf3c {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:20 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:20 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c 1073741824
Jun 16 18:42:20 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:22 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c 1073741824" returned: 0 in 1.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:22 devstack sudo[99704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c
Jun 16 18:42:22 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:23 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c" returned: 0 in 1.303s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] <== create_volume: return (2966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.969s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799dddcc-2137-4c17-96de-0170275eeb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37be1fb2-f076-40a0-b89a-cdccd24630ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:23 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c (e3a9f216-1234-4de8-ae74-8f43f574cf3c): created successfully
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37be1fb2-f076-40a0-b89a-cdccd24630ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (69f1bb17-e0f1-43df-ba4e-d62ecee68519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1dc75943-b326-41d6-9e36-f69d179ec8cf tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created volume successfully.
Jun 16 18:42:25 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (c2022aef-25b0-4164-a388-cc05372feece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8d0961-ab89-4fd9-8cb6-13022dbf8e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8d0961-ab89-4fd9-8cb6-13022dbf8e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738750905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737dbcd9-d2dc-4897-b045-9090bac3f05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:26Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1146db07-ce1d-419b-8d9d-39da97877286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1146db07-ce1d-419b-8d9d-39da97877286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9c90f3-e9b7-450e-bc42-f4067225c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9c90f3-e9b7-450e-bc42-f4067225c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '737dbcd9-d2dc-4897-b045-9090bac3f05d', 'volume_name': 'volume-737dbcd9-d2dc-4897-b045-9090bac3f05d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dedd584-2275-4e69-83af-c34c41b34898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dedd584-2275-4e69-83af-c34c41b34898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d5bce5-d089-4a22-98c8-c3e8ecb05d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume 737dbcd9-d2dc-4897-b045-9090bac3f05d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-737dbcd9-d2dc-4897-b045-9090bac3f05d', 'volume_size': 1}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738750905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737dbcd9-d2dc-4897-b045-9090bac3f05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:26Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Creating volume 737dbcd9-d2dc-4897-b045-9090bac3f05d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:26 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:26 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d 1073741824
Jun 16 18:42:26 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Acquiring lock "cinder-4d40b9d1-16ad-4370-a5fb-edf66767f1b7-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Lock "cinder-4d40b9d1-16ad-4370-a5fb-edf66767f1b7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Acquiring lock "cinder-quobyte-4d40b9d1-16ad-4370-a5fb-edf66767f1b7" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Lock "cinder-quobyte-4d40b9d1-16ad-4370-a5fb-edf66767f1b7" acquired by "delete_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3829def-6e4a-40e7-8999-c8c504cd2ae4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:26 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7
Jun 16 18:42:26 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (65e87476-309c-4b46-9c0a-acffe230c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacd7c08-4f26-42cb-b859-c7f2f03a77b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacd7c08-4f26-42cb-b859-c7f2f03a77b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-394691146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b67e0da-01d8-45c7-8b4e-53e315785281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:27Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0ba91b-1cf0-4a5d-bfe3-f6a1bc8505f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0ba91b-1cf0-4a5d-bfe3-f6a1bc8505f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25845649-9997-4f20-80da-aa80535526da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25845649-9997-4f20-80da-aa80535526da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b67e0da-01d8-45c7-8b4e-53e315785281', 'volume_name': 'volume-1b67e0da-01d8-45c7-8b4e-53e315785281', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e15e2a-3a8a-4e5a-8615-324b1d84f9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e15e2a-3a8a-4e5a-8615-324b1d84f9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8228b1c3-eeaa-488b-8e6f-faba6ed859db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:26 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume 1b67e0da-01d8-45c7-8b4e-53e315785281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b67e0da-01d8-45c7-8b4e-53e315785281', 'volume_size': 1}
Jun 16 18:42:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (b9f8d5b1-d7fc-435b-9c1a-2581b3693bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66428533-d307-4e65-a0a9-07bb69526a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66428533-d307-4e65-a0a9-07bb69526a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965136315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf84443-a7ea-4d5f-8979-8b5ec48da535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:27Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e327cd-dbce-4d81-b966-88fd269d1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e327cd-dbce-4d81-b966-88fd269d1245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeb0ec9-1647-4e5f-805f-fb75551db0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeb0ec9-1647-4e5f-805f-fb75551db0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf84443-a7ea-4d5f-8979-8b5ec48da535', 'volume_name': 'volume-daf84443-a7ea-4d5f-8979-8b5ec48da535', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f749f-bf3f-4cab-b84a-2f37d907bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f749f-bf3f-4cab-b84a-2f37d907bba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ce0a12-8303-4f61-bd4e-776ab6a1c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:27 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume daf84443-a7ea-4d5f-8979-8b5ec48da535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf84443-a7ea-4d5f-8979-8b5ec48da535', 'volume_size': 1}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:27 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d 1073741824" returned: 0 in 1.563s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:27 devstack sudo[99752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d
Jun 16 18:42:27 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:28 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (565d76d3-6fd0-491a-a720-49b70961d96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cf9d1d-cbb7-4f49-afa7-0deb8313b2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7" returned: 0 in 1.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cf9d1d-cbb7-4f49-afa7-0deb8313b2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733799642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:28Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:28 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7
Jun 16 18:42:28 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88da1d9-0bb5-4341-a2c5-df642af63f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88da1d9-0bb5-4341-a2c5-df642af63f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ab2d60-4337-43ed-a5b6-5a0e37c4d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ab2d60-4337-43ed-a5b6-5a0e37c4d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6', 'volume_name': 'volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc436d9-fb3e-47bb-8546-c1c87a19899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc436d9-fb3e-47bb-8546-c1c87a19899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bca7c8c-fe96-45e6-aa26-01d67229efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:28 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume 18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6', 'volume_size': 1}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:28 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d" returned: 0 in 0.766s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.563s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-394691146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b67e0da-01d8-45c7-8b4e-53e315785281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:27Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Creating volume 1b67e0da-01d8-45c7-8b4e-53e315785281 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:28 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d5bce5-d089-4a22-98c8-c3e8ecb05d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737dbcd9-d2dc-4897-b045-9090bac3f05d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:28 devstack sudo[99760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281 1073741824
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23961ef-e5cc-4520-945d-880038f5d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:28 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:28 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume volume-737dbcd9-d2dc-4897-b045-9090bac3f05d (737dbcd9-d2dc-4897-b045-9090bac3f05d): created successfully
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23961ef-e5cc-4520-945d-880038f5d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (c2022aef-25b0-4164-a388-cc05372feece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:28 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d9c92271-d257-4e31-b8b9-90876fb1ae66 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created volume successfully.
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (47d61789-d5a8-4f7e-a143-6bf17b4bc731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be513e05-9bfc-482d-8cc9-a7c171bd675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be513e05-9bfc-482d-8cc9-a7c171bd675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478974092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25306abd-342a-42cf-9edf-7255efcd33a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:29Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e63c0f5-6d54-4e19-a64b-60c04e663407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e63c0f5-6d54-4e19-a64b-60c04e663407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed91788-393c-484a-840e-023398a1f4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed91788-393c-484a-840e-023398a1f4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25306abd-342a-42cf-9edf-7255efcd33a4', 'volume_name': 'volume-25306abd-342a-42cf-9edf-7255efcd33a4', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a9edc9-cc21-41a1-9841-111a298d0a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a9edc9-cc21-41a1-9841-111a298d0a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06450894-ae6b-4d46-b8db-e6c104da57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:29 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume 25306abd-342a-42cf-9edf-7255efcd33a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25306abd-342a-42cf-9edf-7255efcd33a4', 'volume_size': 1}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:29 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d40b9d1-16ad-4370-a5fb-edf66767f1b7" returned: 0 in 1.155s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Lock "cinder-quobyte-4d40b9d1-16ad-4370-a5fb-edf66767f1b7" released by "delete_volume" :: held 2.885s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Created reservations ['dcf3767f-d168-4459-a174-588e2d50ebb5', 'fb1dd09b-4ebc-4af3-9259-d8f7938eb627', 'e093daaa-3b76-4259-b69b-1fd694a00063', '88743955-a993-46b3-9238-5c4e4c8f7daa'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:29 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:29 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:30 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281 1073741824" returned: 0 in 1.546s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:30 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281
Jun 16 18:42:30 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:30 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.938s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Deleted volume successfully.
Jun 16 18:42:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a258b2fa-7336-48ef-bd56-6934e2eb72ae tempest-VolumesNegativeTest-537522617 None] Lock "cinder-4d40b9d1-16ad-4370-a5fb-edf66767f1b7-delete_volume" released by "delete_volume" :: held 4.230s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:31 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281" returned: 0 in 0.896s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] <== create_volume: return (2522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.526s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.479s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965136315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf84443-a7ea-4d5f-8979-8b5ec48da535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:27Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Creating volume daf84443-a7ea-4d5f-8979-8b5ec48da535 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:31 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:31 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 1073741824
Jun 16 18:42:31 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8228b1c3-eeaa-488b-8e6f-faba6ed859db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b67e0da-01d8-45c7-8b4e-53e315785281', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f8621c-3405-4ce2-9b90-58ba9fc2182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:31 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume volume-1b67e0da-01d8-45c7-8b4e-53e315785281 (1b67e0da-01d8-45c7-8b4e-53e315785281): created successfully
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f8621c-3405-4ce2-9b90-58ba9fc2182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (65e87476-309c-4b46-9c0a-acffe230c677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5e678879-5a7d-4525-b0fa-142af13af537 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created volume successfully.
Jun 16 18:42:32 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 1073741824" returned: 0 in 1.398s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:32 devstack sudo[99779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535
Jun 16 18:42:32 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:33 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535" returned: 0 in 0.819s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.987s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733799642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:28Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Creating volume 18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:33 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ce0a12-8303-4f61-bd4e-776ab6a1c44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf84443-a7ea-4d5f-8979-8b5ec48da535', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:33 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 1073741824
Jun 16 18:42:33 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b88cfce-3d26-48a2-97bf-5dda4d93ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:33 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 (daf84443-a7ea-4d5f-8979-8b5ec48da535): created successfully
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b88cfce-3d26-48a2-97bf-5dda4d93ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (b9f8d5b1-d7fc-435b-9c1a-2581b3693bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6b38e511-0184-4b9e-bff2-5e731b03bbb7 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created volume successfully.
Jun 16 18:42:34 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 1073741824" returned: 0 in 1.168s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:34 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6
Jun 16 18:42:34 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:35 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6" returned: 0 in 0.975s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.291s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478974092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25306abd-342a-42cf-9edf-7255efcd33a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d6dc797c0b4e4bb3750605c83b0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:29Z,use_quota=True,user_id='a60c6bfb9d124227a2cf732bff2ed422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Creating volume 25306abd-342a-42cf-9edf-7255efcd33a4 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:35 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:35 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4 1073741824
Jun 16 18:42:35 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bca7c8c-fe96-45e6-aa26-01d67229efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97567a91-4d73-4e33-9cd0-dd4bb91a3f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:35 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 (18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6): created successfully
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97567a91-4d73-4e33-9cd0-dd4bb91a3f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (565d76d3-6fd0-491a-a720-49b70961d96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-187874d1-acff-4f21-a51f-45502b102888 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created volume successfully.
Jun 16 18:42:36 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4 1073741824" returned: 0 in 1.018s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:36 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4
Jun 16 18:42:36 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:37 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4" returned: 0 in 0.656s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06450894-ae6b-4d46-b8db-e6c104da57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25306abd-342a-42cf-9edf-7255efcd33a4', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9dd4738-c5b0-4e4b-9e54-e4d79cd2e1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Volume volume-25306abd-342a-42cf-9edf-7255efcd33a4 (25306abd-342a-42cf-9edf-7255efcd33a4): created successfully
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9dd4738-c5b0-4e4b-9e54-e4d79cd2e1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Flow 'volume_create_manager' (47d61789-d5a8-4f7e-a143-6bf17b4bc731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0edb34d7-d296-4ebe-bd4f-75013e3d89f6 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created volume successfully.
Jun 16 18:42:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-25306abd-342a-42cf-9edf-7255efcd33a4-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-25306abd-342a-42cf-9edf-7255efcd33a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-quobyte-25306abd-342a-42cf-9edf-7255efcd33a4" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-25306abd-342a-42cf-9edf-7255efcd33a4" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:38 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[89930ce7-028a-4ac2-a76a-ab472125805b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:38 devstack sudo[99827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4
Jun 16 18:42:38 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:39 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4" returned: 0 in 0.807s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:39 devstack sudo[99832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4
Jun 16 18:42:39 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:39 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-25306abd-342a-42cf-9edf-7255efcd33a4" returned: 0 in 0.645s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-25306abd-342a-42cf-9edf-7255efcd33a4" released by "delete_volume" :: held 1.491s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created reservations ['8f474b3a-8879-4a6e-a545-3e26ef78d1bc', 'ba1fef8d-f035-4029-926a-8c31fdb7664a', '11733c94-0745-4637-8b84-4d58d3e427f9', '8d5040c1-1837-4699-95a6-9f8ce77e80df'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:39 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:39 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:40 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.632s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-quobyte-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:40 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Deleted volume successfully.
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a29bca8-82f3-49fe-9208-696f2b7e4b0a tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-25306abd-342a-42cf-9edf-7255efcd33a4-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c4bae-cb57-407e-a280-ea8cbdee73cc]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:40 devstack sudo[99839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6
Jun 16 18:42:40 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:41 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6" returned: 0 in 0.853s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:41 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6
Jun 16 18:42:41 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:42 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:42 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:42 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6" released by "delete_volume" :: held 1.657s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created reservations ['44c5aa04-6520-4ed8-829a-480f67059094', 'd351bdf8-012f-4b46-92ad-b33fdbebe4e8', '8eb4ada7-a525-43fb-9a60-d373f9ef901e', '0836840e-cf1e-41c0-872d-3eae0d0a72e7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:42 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:42 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-daf84443-a7ea-4d5f-8979-8b5ec48da535-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-daf84443-a7ea-4d5f-8979-8b5ec48da535-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:42 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.789s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-quobyte-daf84443-a7ea-4d5f-8979-8b5ec48da535" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-daf84443-a7ea-4d5f-8979-8b5ec48da535" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7546933c-ec26-4d54-a942-df1277d6184c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:43 devstack sudo[99852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535
Jun 16 18:42:43 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:43 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.774s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Deleted volume successfully.
Jun 16 18:42:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4efdde0d-2d0a-4f66-8a42-c03fc266a59d tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-18aa9ceb-d63d-4da9-9149-1fa0cb1e7ae6-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:43 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535" returned: 0 in 0.754s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:43 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535
Jun 16 18:42:43 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:44 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-daf84443-a7ea-4d5f-8979-8b5ec48da535" returned: 0 in 0.752s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-daf84443-a7ea-4d5f-8979-8b5ec48da535" released by "delete_volume" :: held 1.557s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created reservations ['3c068599-fc63-43b0-a6fe-97efa7308d6d', 'c1a8ee53-48e8-469d-bb07-a3c3b91873da', '5dad0aa5-f1a6-40b0-bba9-89fdfe36d2b0', '26540387-175c-4b75-b3ce-609f4aa0baed'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:44 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:44 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-1b67e0da-01d8-45c7-8b4e-53e315785281-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-1b67e0da-01d8-45c7-8b4e-53e315785281-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-quobyte-1b67e0da-01d8-45c7-8b4e-53e315785281" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-1b67e0da-01d8-45c7-8b4e-53e315785281" acquired by "delete_volume" :: waited 0.040s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:45 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.838s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:45 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Deleted volume successfully.
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4441bf-5f68-4d19-9086-ccd24c08ac4a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6795b8ad-8d5f-4245-9402-69627bcca649 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-daf84443-a7ea-4d5f-8979-8b5ec48da535-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:45 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281
Jun 16 18:42:45 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:46 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281" returned: 0 in 1.251s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:46 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281
Jun 16 18:42:46 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:47 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1b67e0da-01d8-45c7-8b4e-53e315785281" returned: 0 in 0.960s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-1b67e0da-01d8-45c7-8b4e-53e315785281" released by "delete_volume" :: held 2.364s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created reservations ['2a6affcb-f8e9-4a0e-9a17-95c0d49bb179', 'a81cad84-bdcd-46f2-b3a1-95532cc99c68', 'f6ef30c9-cc80-4df4-a364-a4003ddaceb7', '148420d8-6002-406e-83f2-18059a3e1c50'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:47 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:47 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:48 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Deleted volume successfully.
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-497b5a8c-068f-41ae-b0ef-b1534d021799 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-1b67e0da-01d8-45c7-8b4e-53e315785281-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-737dbcd9-d2dc-4897-b045-9090bac3f05d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-737dbcd9-d2dc-4897-b045-9090bac3f05d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-quobyte-737dbcd9-d2dc-4897-b045-9090bac3f05d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-737dbcd9-d2dc-4897-b045-9090bac3f05d" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[655ade98-8bcf-4867-9fcc-d2c519e00406]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:48 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d
Jun 16 18:42:48 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:49 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d" returned: 0 in 0.752s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:49 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d
Jun 16 18:42:49 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:50 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-737dbcd9-d2dc-4897-b045-9090bac3f05d" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-737dbcd9-d2dc-4897-b045-9090bac3f05d" released by "delete_volume" :: held 1.404s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created reservations ['88c726c1-de31-44ea-ab31-6b36e1105943', '8be777ef-632c-4298-8a22-8bcf0408ac47', 'de9f2953-f079-4ac6-a28c-00f615244ade', 'a264ff74-2e68-4cea-a6b5-4ed47237cb88'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:50 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:50 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-e3a9f216-1234-4de8-ae74-8f43f574cf3c-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-e3a9f216-1234-4de8-ae74-8f43f574cf3c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:50 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "cinder-quobyte-e3a9f216-1234-4de8-ae74-8f43f574cf3c" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Deleted volume successfully.
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-e3a9f216-1234-4de8-ae74-8f43f574cf3c" acquired by "delete_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b266b79e-33e9-4e49-8801-3a8ce632eb2f tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-737dbcd9-d2dc-4897-b045-9090bac3f05d-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a9aff7-d33b-42dc-b50a-23d2ddae3848]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:51 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c
Jun 16 18:42:51 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:51 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c" returned: 0 in 0.840s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:51 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c
Jun 16 18:42:51 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "cinder-f295bf60-7c41-4ba3-a883-a2df8d2d0629-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-f295bf60-7c41-4ba3-a883-a2df8d2d0629-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "cinder-quobyte-f295bf60-7c41-4ba3-a883-a2df8d2d0629" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-quobyte-f295bf60-7c41-4ba3-a883-a2df8d2d0629" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aab4673-21a3-4210-b120-47427bc8019f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:52 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629
Jun 16 18:42:52 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:52 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e3a9f216-1234-4de8-ae74-8f43f574cf3c" returned: 0 in 0.722s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-quobyte-e3a9f216-1234-4de8-ae74-8f43f574cf3c" released by "delete_volume" :: held 1.626s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Created reservations ['4949c896-a973-40d1-9062-ac92d087648b', '2b47394d-2963-4179-b103-4c59a5c7776a', '06878ed9-0a6b-4aa4-be76-46aeb2fb3a71', '90cabd36-fe72-4629-892d-09d0ec5a760b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:52 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:52 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:53 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629" returned: 0 in 0.759s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:53 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629
Jun 16 18:42:53 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:53 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.856s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Deleted volume successfully.
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c44ce803-2e93-416a-9a23-4d003bb039c0 tempest-CreateVolumesFromSourceVolumeTest-23627400 None] Lock "cinder-e3a9f216-1234-4de8-ae74-8f43f574cf3c-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:53 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f295bf60-7c41-4ba3-a883-a2df8d2d0629" returned: 0 in 0.780s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-quobyte-f295bf60-7c41-4ba3-a883-a2df8d2d0629" released by "delete_volume" :: held 1.592s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Created reservations ['e3629158-8eb3-4e95-9485-fa1f8633c9cc', '5410ad04-f211-420f-b929-812bc20242c3', 'cf781705-7fa5-4e42-b76a-72e261c398d4', '765ac3ac-ff53-4c64-a7fd-a85c31e3edff'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:54 devstack sudo[99959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:54 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "cinder-f57ff4e3-262e-4896-9bcb-c5c32fde304e-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-f57ff4e3-262e-4896-9bcb-c5c32fde304e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:54 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.788s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "cinder-quobyte-f57ff4e3-262e-4896-9bcb-c5c32fde304e" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:42:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Deleted volume successfully.
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-quobyte-f57ff4e3-262e-4896-9bcb-c5c32fde304e" acquired by "delete_volume" :: waited 0.034s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:42:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1635e982-bd8e-4988-8845-d0a072728d55 tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-f295bf60-7c41-4ba3-a883-a2df8d2d0629-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2251b755-e97d-40e3-ada2-5c38481d83a0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:42:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:55 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e
Jun 16 18:42:55 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:55 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e" returned: 0 in 0.736s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:55 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e
Jun 16 18:42:55 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:56 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f57ff4e3-262e-4896-9bcb-c5c32fde304e" returned: 0 in 0.722s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-quobyte-f57ff4e3-262e-4896-9bcb-c5c32fde304e" released by "delete_volume" :: held 1.524s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Created reservations ['4ab3e042-8df5-4d78-aea9-95dba7939b17', '156229e1-6065-44d4-aa68-3f92b56500eb', 'd75a9a86-ec7d-4d2e-8a94-835a784393bf', 'aed6aa4d-09d3-4798-9098-b1038244a8d7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:56 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:42:56 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Flow 'volume_create_manager' (ef866668-4feb-4a1a-bb70-89f939c28e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3024f378-54bc-4594-b023-487115fa0ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3024f378-54bc-4594-b023-487115fa0ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647d33d5-65d9-482f-a127-d1e85b1419fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02793869436d47148cb4954dfa36092e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:57Z,use_quota=True,user_id='c80f3ff0ae564da8a3ea67dee53e0570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3eaf17-896d-4f95-97e7-f1658982562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3eaf17-896d-4f95-97e7-f1658982562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eef2b6f-58ef-4ade-8598-8a2c2b8b9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eef2b6f-58ef-4ade-8598-8a2c2b8b9ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647d33d5-65d9-482f-a127-d1e85b1419fc', 'volume_name': 'volume-647d33d5-65d9-482f-a127-d1e85b1419fc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583cf68e-5195-4595-8ef4-8e42e3e060c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583cf68e-5195-4595-8ef4-8e42e3e060c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ae5da5-4c52-4db2-a618-8028aac4d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Volume 647d33d5-65d9-482f-a127-d1e85b1419fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647d33d5-65d9-482f-a127-d1e85b1419fc', 'volume_size': 1}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647d33d5-65d9-482f-a127-d1e85b1419fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02793869436d47148cb4954dfa36092e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:57Z,use_quota=True,user_id='c80f3ff0ae564da8a3ea67dee53e0570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Creating volume 647d33d5-65d9-482f-a127-d1e85b1419fc {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:56 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:56 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc 1073741824
Jun 16 18:42:56 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:57 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.677s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:57 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:42:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Deleted volume successfully.
Jun 16 18:42:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dbafe074-5ded-4540-a130-878815f7ac3e tempest-AttachVolumeShelveTestJSON-917558730 None] Lock "cinder-f57ff4e3-262e-4896-9bcb-c5c32fde304e-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:42:57 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc 1073741824" returned: 0 in 0.872s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:57 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc
Jun 16 18:42:57 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:42:58 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc" returned: 0 in 0.673s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ae5da5-4c52-4db2-a618-8028aac4d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647d33d5-65d9-482f-a127-d1e85b1419fc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b2327c-5185-4815-8bab-3724c55cabd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Volume volume-647d33d5-65d9-482f-a127-d1e85b1419fc (647d33d5-65d9-482f-a127-d1e85b1419fc): created successfully
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b2327c-5185-4815-8bab-3724c55cabd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Flow 'volume_create_manager' (ef866668-4feb-4a1a-bb70-89f939c28e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8b2c88e0-62df-40bc-aa6f-a5430bbb3426 tempest-CinderUnicodeTest-1047887638 None] Created volume successfully.
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Flow 'volume_create_manager' (08305ede-0ee5-4512-a537-5ee826a99a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6956d4ee-6f3b-4523-bf1c-ca0baf1af8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6956d4ee-6f3b-4523-bf1c-ca0baf1af8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1164557460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108c424c-ee07-4706-9532-8810a6c2afb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02793869436d47148cb4954dfa36092e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:59Z,use_quota=True,user_id='c80f3ff0ae564da8a3ea67dee53e0570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f35f031-3287-4712-8938-a5d9e87e5d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f35f031-3287-4712-8938-a5d9e87e5d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2da0530-1bad-4192-a72b-700d54cb3110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2da0530-1bad-4192-a72b-700d54cb3110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108c424c-ee07-4706-9532-8810a6c2afb6', 'volume_name': 'volume-108c424c-ee07-4706-9532-8810a6c2afb6', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f802ee-9c22-4a0b-8015-454b6708da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f802ee-9c22-4a0b-8015-454b6708da3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75de741-ec4a-472b-be97-055db3707dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:42:59 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Volume 108c424c-ee07-4706-9532-8810a6c2afb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108c424c-ee07-4706-9532-8810a6c2afb6', 'volume_size': 1}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:42:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1164557460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108c424c-ee07-4706-9532-8810a6c2afb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02793869436d47148cb4954dfa36092e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:42:59Z,use_quota=True,user_id='c80f3ff0ae564da8a3ea67dee53e0570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Creating volume 108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:42:59 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:42:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:42:59 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 1073741824
Jun 16 18:42:59 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:00 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 1073741824" returned: 0 in 1.065s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:00 devstack sudo[99993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6
Jun 16 18:43:00 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Flow 'volume_create_manager' (88e53edf-5a6d-4b87-95fb-96562848a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acae196-5420-4ecf-a4d8-f18215373474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acae196-5420-4ecf-a4d8-f18215373474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-891520205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30979fc9-6865-4022-a30e-9cc5e0850258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d259135052047d4b9dcf7a2018bc024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:01Z,use_quota=True,user_id='c09dc86fda344d13b2b94482309a8003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d03816-255e-4bee-a1d9-41c207d80295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d03816-255e-4bee-a1d9-41c207d80295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07cac54-b923-4319-abbf-b8a2de4e438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07cac54-b923-4319-abbf-b8a2de4e438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30979fc9-6865-4022-a30e-9cc5e0850258', 'volume_name': 'volume-30979fc9-6865-4022-a30e-9cc5e0850258', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be8fab3-5f08-4de9-8e76-e9e23d5dc9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be8fab3-5f08-4de9-8e76-e9e23d5dc9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc9afae-e972-4470-8499-efc24ae40672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Volume 30979fc9-6865-4022-a30e-9cc5e0850258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30979fc9-6865-4022-a30e-9cc5e0850258', 'volume_size': 1}
Jun 16 18:43:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Flow 'volume_create_manager' (dc4057de-592e-4f67-a3a2-feef99e77b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856e457-76c2-4705-bb02-092df964264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856e457-76c2-4705-bb02-092df964264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2052179041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc585153-7fa8-45cc-a1dd-88f5c411534b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0115a9a1cf444d9393b223a80d0edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:01Z,use_quota=True,user_id='2bf6f56860e84e8fa3356e59b0c0f44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0193df-52b6-4d04-a71c-c6dbf7f1efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0193df-52b6-4d04-a71c-c6dbf7f1efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88ae3b8-8b2f-4f33-8185-5ffbae8a1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:43:01 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6" returned: 0 in 0.925s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-891520205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30979fc9-6865-4022-a30e-9cc5e0850258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d259135052047d4b9dcf7a2018bc024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:01Z,use_quota=True,user_id='c09dc86fda344d13b2b94482309a8003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Creating volume 30979fc9-6865-4022-a30e-9cc5e0850258 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:43:01 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75de741-ec4a-472b-be97-055db3707dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108c424c-ee07-4706-9532-8810a6c2afb6', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6997e71-c6bc-4fae-b49b-7be7555c0201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:01 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 1073741824
Jun 16 18:43:01 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:01 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Volume volume-108c424c-ee07-4706-9532-8810a6c2afb6 (108c424c-ee07-4706-9532-8810a6c2afb6): created successfully
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6997e71-c6bc-4fae-b49b-7be7555c0201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Flow 'volume_create_manager' (08305ede-0ee5-4512-a537-5ee826a99a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a873ae7c-fdab-4938-9a74-b90c9933659a tempest-CinderUnicodeTest-1047887638 None] Created volume successfully.
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88ae3b8-8b2f-4f33-8185-5ffbae8a1568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc585153-7fa8-45cc-a1dd-88f5c411534b', 'volume_name': 'volume-cc585153-7fa8-45cc-a1dd-88f5c411534b', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b6c01d0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5151ff6c-cdca-4163-afbb-cabbe2175807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5151ff6c-cdca-4163-afbb-cabbe2175807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5680ca6e-5218-48aa-9b81-0456c3127f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:01 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Volume cc585153-7fa8-45cc-a1dd-88f5c411534b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc585153-7fa8-45cc-a1dd-88f5c411534b', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b6c01d0>}
Jun 16 18:43:01 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Trying to clone cc585153-7fa8-45cc-a1dd-88f5c411534b from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:43:02 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:43:02 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Image download 20.69 MB at 20.69 MB/s
Jun 16 18:43:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e08014d-24b4-4c7e-8493-a618eddb2844]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:02 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD
Jun 16 18:43:02 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:02 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 1073741824" returned: 0 in 1.047s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:02 devstack sudo[100006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258
Jun 16 18:43:02 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:03 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d is fetched for user 2bf6f56860e84e8fa3356e59b0c0f44f. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d464b-37ef-45ea-8deb-194f5b30a651]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:03 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD
Jun 16 18:43:03 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:03 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258" returned: 0 in 0.766s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc9afae-e972-4470-8499-efc24ae40672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30979fc9-6865-4022-a30e-9cc5e0850258', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310178aa-cbe8-466c-93bd-fa97ac7e18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Creating offline snapshot 7623c41b-cc85-43c5-847e-88240e455434 of volume 108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:43:03 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Volume volume-30979fc9-6865-4022-a30e-9cc5e0850258 (30979fc9-6865-4022-a30e-9cc5e0850258): created successfully
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310178aa-cbe8-466c-93bd-fa97ac7e18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Flow 'volume_create_manager' (88e53edf-5a6d-4b87-95fb-96562848a39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc3751-daeb-483e-b170-b24c1517772b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0c3d2ed9-5d26-46db-9b70-7bb82bbd1271 tempest-AttachVolumeTestJSON-1918294011 None] Created volume successfully.
Jun 16 18:43:03 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6
Jun 16 18:43:03 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:03 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:04 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6" returned: 0 in 0.834s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:04 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 1G
Jun 16 18:43:04 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:05 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 1G" returned: 0 in 0.761s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-108c424c-ee07-4706-9532-8810a6c2afb6 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:05 devstack sudo[100031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-108c424c-ee07-4706-9532-8810a6c2afb6 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434
Jun 16 18:43:05 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:05 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-108c424c-ee07-4706-9532-8810a6c2afb6 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434" returned: 0 in 0.657s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:05 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 is being set with open permissions: ugo+rw
Jun 16 18:43:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:05 devstack sudo[100036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434
Jun 16 18:43:05 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:06 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:06 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=70,cinder:UPDATE=124,cinder:INSERT=33,cinder:DELETE=6 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:43:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:06 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info
Jun 16 18:43:06 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:06 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:06 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info is being set with open permissions: ugo+rw
Jun 16 18:43:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:06 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info
Jun 16 18:43:06 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:07 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.info" returned: 0 in 0.628s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.700s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2052179041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc585153-7fa8-45cc-a1dd-88f5c411534b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0115a9a1cf444d9393b223a80d0edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:01Z,use_quota=True,user_id='2bf6f56860e84e8fa3356e59b0c0f44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Creating volume cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:43:07 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:43:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:07 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-37ba6e2d-e812-403f-ba76-b82016cbb650 tempest-CinderUnicodeTest-1047887638 None] Create snapshot completed successfully
Jun 16 18:43:07 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b 1073741824
Jun 16 18:43:07 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-7623c41b-cc85-43c5-847e-88240e455434-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-7623c41b-cc85-43c5-847e-88240e455434-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-quobyte-108c424c-ee07-4706-9532-8810a6c2afb6" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-108c424c-ee07-4706-9532-8810a6c2afb6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-quobyte-7623c41b-cc85-43c5-847e-88240e455434" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-7623c41b-cc85-43c5-847e-88240e455434" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Deleting offline snapshot 7623c41b-cc85-43c5-847e-88240e455434 of volume 108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] snapshot_file for this snap is: volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f50b927-aba9-4c97-96d3-00772deefd64]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:08 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434
Jun 16 18:43:08 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:08 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b 1073741824" returned: 0 in 0.862s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:08 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:08 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:09 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434" returned: 0 in 0.891s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-108c424c-ee07-4706-9532-8810a6c2afb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c806441-dd87-430f-b17e-c40001442c5f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:09 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 0 in 0.845s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.105s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:09 devstack sudo[100069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6
Jun 16 18:43:09 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ece99d-fb8c-49d1-8d77-b3ff9fc182d2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Attempting download of 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume cc585153-7fa8-45cc-a1dd-88f5c411534b. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2291bd-b65b-410c-a350-cbf850092dd3]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:09 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258
Jun 16 18:43:09 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:09 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd
Jun 16 18:43:09 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:10 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd" returned: 0 in 0.811s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:10 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258" returned: 0 in 0.937s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-30979fc9-6865-4022-a30e-9cc5e0850258', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30638058-2ae0-4f4c-b395-605c3be431eb', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:43:10 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6" returned: 0 in 1.123s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:10 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434
Jun 16 18:43:10 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:10 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd
Jun 16 18:43:10 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-44789441-2315-41e1-b33f-38ce9b4948f3 req-fc88a30f-bfa8-4abb-a6fa-e0932ef816a8 tempest-AttachVolumeTestJSON-1918294011 None] attachment_update completed successfully.
Jun 16 18:43:11 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd" returned: 1 in 0.879s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_hn7d1imd' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:43:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9950f08-e3cc-4209-8c2e-e6259d5ec338]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:11 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434" returned: 0 in 0.859s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:11 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434
Jun 16 18:43:11 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:11 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD
Jun 16 18:43:11 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:12 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD" returned: 0 in 1.004s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d was qcow2, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:12 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:12 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:12 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6.7623c41b-cc85-43c5-847e-88240e455434" returned: 0 in 1.058s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-7623c41b-cc85-43c5-847e-88240e455434" released by "_delete_snapshot" :: held 4.107s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-108c424c-ee07-4706-9532-8810a6c2afb6" released by "delete_snapshot" :: held 4.139s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Created reservations ['be34a12b-53e2-4858-bf9c-7c93956e5b37', 'b3c85b85-8258-46fb-87b5-ad0478024f2d', 'c0921ef9-cb7b-4817-8a89-c2efcb93e550', '6117028c-1d6d-4b52-8874-a6769d9e9545'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Delete snapshot completed successfully.
Jun 16 18:43:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1c45b8cd-eccd-4d97-afd1-6a0f18a4954f tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-7623c41b-cc85-43c5-847e-88240e455434-delete_snapshot" released by "delete_snapshot" :: held 4.356s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-108c424c-ee07-4706-9532-8810a6c2afb6-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-108c424c-ee07-4706-9532-8810a6c2afb6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-quobyte-108c424c-ee07-4706-9532-8810a6c2afb6" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-108c424c-ee07-4706-9532-8810a6c2afb6" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:13 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367adaf-f4e1-46b1-bcc6-8e5d1c231f21]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:13 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6
Jun 16 18:43:13 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:14 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 0 in 2.238s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:14 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_uolyqpfedevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:43:14 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Converted 112.00 MB image at 49.97 MB/s
Jun 16 18:43:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:14 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b 1G
Jun 16 18:43:14 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:14 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6" returned: 0 in 0.847s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:14 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6
Jun 16 18:43:14 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:15 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-108c424c-ee07-4706-9532-8810a6c2afb6" returned: 0 in 0.645s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-108c424c-ee07-4706-9532-8810a6c2afb6" released by "delete_volume" :: held 1.587s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:INSERT=23,cinder:SELECT=100,cinder:UPDATE=113,cinder:DELETE=13 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:43:15 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b 1G" returned: 0 in 0.858s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Created reservations ['03a76fe6-e1f1-468d-b70b-12d73e6a6657', '8567f157-5c77-4061-8ba2-a8aea8c276f5', 'b9359348-04f3-4244-bd5a-33844ec005b6', '2c5eeae1-8670-47fa-a1b7-72b4f409851d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a60a5-e768-4467-b14f-2696522cb2cb]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:15 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:15 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:15 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:15 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-647d33d5-65d9-482f-a127-d1e85b1419fc-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-647d33d5-65d9-482f-a127-d1e85b1419fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "cinder-quobyte-647d33d5-65d9-482f-a127-d1e85b1419fc" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-647d33d5-65d9-482f-a127-d1e85b1419fc" acquired by "delete_volume" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa844d98-1770-4db2-8520-d7ce4bc972e3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:16 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.894s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Deleted volume successfully.
Jun 16 18:43:16 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 0 in 1.023s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6692681b-5c57-452b-9631-c546d97ed1f3 tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-108c424c-ee07-4706-9532-8810a6c2afb6-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:16 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc
Jun 16 18:43:16 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:16 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:16 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Flow 'volume_create_manager' (3429e953-3758-4ff3-9d62-4dd782eebc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5decd65c-95a7-4a80-aa88-5e43584c3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5decd65c-95a7-4a80-aa88-5e43584c3496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1483936448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7e1a15-f043-4ea0-9bb6-caf813202c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d259135052047d4b9dcf7a2018bc024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:17Z,use_quota=True,user_id='c09dc86fda344d13b2b94482309a8003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57127bf-6f51-4d0f-ab18-69b152f56f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57127bf-6f51-4d0f-ab18-69b152f56f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f2ab14-6d31-4e77-a15c-a7fe9ffd80e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f2ab14-6d31-4e77-a15c-a7fe9ffd80e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7e1a15-f043-4ea0-9bb6-caf813202c32', 'volume_name': 'volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7d29dd-dc99-408c-bc0d-590e373bba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7d29dd-dc99-408c-bc0d-590e373bba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b7f76e-8989-4e45-bcc9-c37a7e84506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:16 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Volume 4e7e1a15-f043-4ea0-9bb6-caf813202c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32', 'volume_size': 1}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1483936448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7e1a15-f043-4ea0-9bb6-caf813202c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d259135052047d4b9dcf7a2018bc024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:17Z,use_quota=True,user_id='c09dc86fda344d13b2b94482309a8003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Creating volume 4e7e1a15-f043-4ea0-9bb6-caf813202c32 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:43:16 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:43:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:16 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 1073741824
Jun 16 18:43:16 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:17 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc" returned: 0 in 1.124s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:17 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 1 in 0.919s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Downloaded image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume cc585153-7fa8-45cc-a1dd-88f5c411534b successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d for user 2bf6f56860e84e8fa3356e59b0c0f44f is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:43:17 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Marking volume cc585153-7fa8-45cc-a1dd-88f5c411534b as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:43:17 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Copying metadata from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d to cc585153-7fa8-45cc-a1dd-88f5c411534b. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Creating volume glance metadata for volume cc585153-7fa8-45cc-a1dd-88f5c411534b backed by image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5680ca6e-5218-48aa-9b81-0456c3127f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc585153-7fa8-45cc-a1dd-88f5c411534b', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b6c01d0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfc768b-8288-4122-b9a1-107ababb1a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Volume volume-cc585153-7fa8-45cc-a1dd-88f5c411534b (cc585153-7fa8-45cc-a1dd-88f5c411534b): created successfully
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfc768b-8288-4122-b9a1-107ababb1a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Flow 'volume_create_manager' (dc4057de-592e-4f67-a3a2-feef99e77b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:17 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ec358321-0807-40dc-b9b4-e5f7dd744e88 tempest-TestShelveInstance-835433896 None] Created volume successfully.
Jun 16 18:43:17 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 1073741824" returned: 0 in 0.920s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:17 devstack sudo[100532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32
Jun 16 18:43:17 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:17 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-647d33d5-65d9-482f-a127-d1e85b1419fc" returned: 0 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-quobyte-647d33d5-65d9-482f-a127-d1e85b1419fc" released by "delete_volume" :: held 1.944s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Created reservations ['9e8bc2d3-bde0-4a76-99f7-1c8c4c112557', 'b3f6be1e-ecaf-4963-90e6-f7f50c8ea6d6', '4f7ad8b4-ace3-4034-bc80-4201a1016cf7', '63ae4d75-c285-401a-9072-1ad4751a17b3'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:18 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:18 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:18 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32" returned: 0 in 0.894s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b7f76e-8989-4e45-bcc9-c37a7e84506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e9328e-2472-45a1-a725-70aec11e3784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Volume volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 (4e7e1a15-f043-4ea0-9bb6-caf813202c32): created successfully
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e9328e-2472-45a1-a725-70aec11e3784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Flow 'volume_create_manager' (3429e953-3758-4ff3-9d62-4dd782eebc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4a7ba3b2-387a-4760-a742-64efa93723dd tempest-AttachVolumeTestJSON-1918294011 None] Created volume successfully.
Jun 16 18:43:19 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.971s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:19 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Deleted volume successfully.
Jun 16 18:43:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-74690127-9e41-496a-bddd-444c925f5aae tempest-CinderUnicodeTest-1047887638 None] Lock "cinder-647d33d5-65d9-482f-a127-d1e85b1419fc-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:21 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d130206b-b38c-4769-93ce-8359c743b13a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:22 devstack sudo[100558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32
Jun 16 18:43:22 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:22 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32" returned: 0 in 0.721s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '687bb8a1-ffec-4273-8e8c-4f2b2423c217', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:43:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-ca42707e-84f8-40f2-88ea-63bc34fad1a9 req-53d8b1a7-0804-4513-ac4b-d685f3d77030 tempest-AttachVolumeTestJSON-1918294011 None] attachment_update completed successfully.
Jun 16 18:43:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[78699110-fc12-4aa9-9249-8313400fb137]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:26 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:26 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:26 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 0 in 0.751s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:26 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:26 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:27 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 1 in 0.943s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:43:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.753s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-cc585153-7fa8-45cc-a1dd-88f5c411534b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3fe8867-2407-45c1-a49b-640166ba8804', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:43:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-baf8a19c-b792-41e8-b9ac-7868c85d3a67 tempest-TestShelveInstance-835433896 None] attachment_update completed successfully.
Jun 16 18:43:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-3dbb7a00-3af4-4771-9ce9-cb75fa8cd5b9 req-10390fac-cce5-489e-b000-eaec8d21d028 tempest-AttachVolumeTestJSON-1918294011 None] Terminate volume connection completed successfully.
Jun 16 18:43:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-3dbb7a00-3af4-4771-9ce9-cb75fa8cd5b9 req-10390fac-cce5-489e-b000-eaec8d21d028 tempest-AttachVolumeTestJSON-1918294011 None] Deleting attachment 30638058-2ae0-4f4c-b395-605c3be431eb. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:43:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-a5cff440-fffd-4d92-a611-8cd12de9adc3 req-df782f2e-9361-4d11-8fc0-eba0429b1f80 tempest-AttachVolumeTestJSON-1918294011 None] Terminate volume connection completed successfully.
Jun 16 18:43:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-a5cff440-fffd-4d92-a611-8cd12de9adc3 req-df782f2e-9361-4d11-8fc0-eba0429b1f80 tempest-AttachVolumeTestJSON-1918294011 None] Deleting attachment 687bb8a1-ffec-4273-8e8c-4f2b2423c217. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:43:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-836dbdc1-47a6-455d-aacd-96b76210004a tempest-TestShelveInstance-835433896 None] Terminate volume connection completed successfully.
Jun 16 18:43:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-0bbd3279-89eb-43f6-8824-eee64b809f36 req-836dbdc1-47a6-455d-aacd-96b76210004a tempest-TestShelveInstance-835433896 None] Deleting attachment f3fe8867-2407-45c1-a49b-640166ba8804. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:43:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Acquiring lock "cinder-cc585153-7fa8-45cc-a1dd-88f5c411534b-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Lock "cinder-cc585153-7fa8-45cc-a1dd-88f5c411534b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Acquiring lock "cinder-quobyte-cc585153-7fa8-45cc-a1dd-88f5c411534b" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Lock "cinder-quobyte-cc585153-7fa8-45cc-a1dd-88f5c411534b" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:41 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa428d05-7f85-4022-9822-efe7b3ac22fa]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:41 devstack sudo[100806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:41 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:42 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:42 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:42 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 0 in 1.016s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:42 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:42 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:43 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.106s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:43:43 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 1 in 1.012s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:43 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b
Jun 16 18:43:43 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "cinder-4e7e1a15-f043-4ea0-9bb6-caf813202c32-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-4e7e1a15-f043-4ea0-9bb6-caf813202c32-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "cinder-quobyte-4e7e1a15-f043-4ea0-9bb6-caf813202c32" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-quobyte-4e7e1a15-f043-4ea0-9bb6-caf813202c32" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6703d86-e88f-4ac1-9840-cb23ac57f955]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:43 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32
Jun 16 18:43:43 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:43 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cc585153-7fa8-45cc-a1dd-88f5c411534b" returned: 0 in 0.704s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Lock "cinder-quobyte-cc585153-7fa8-45cc-a1dd-88f5c411534b" released by "delete_volume" :: held 2.841s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG cinder.quota [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Created reservations ['b7ebfdfd-2e1c-49ed-bd16-b8d0b06d3fd8', '68bca757-0aa7-4ee7-9c3c-c93ac7b58b7a', '5591267c-3d40-42ad-a4b1-121d4350a115', 'ffd2e7dd-cb29-4095-a980-fbe5ea2b83c0'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:44 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:44 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:44 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32" returned: 0 in 0.828s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:44 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32
Jun 16 18:43:44 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:44 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.777s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG cinder.manager [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Deleted volume successfully.
Jun 16 18:43:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-f858932f-9520-44c9-9711-66ab35c4459a req-98ee1fa1-757c-4db2-8b65-8b295c10e2f4 tempest-TestShelveInstance-835433896 None] Lock "cinder-cc585153-7fa8-45cc-a1dd-88f5c411534b-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:45 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4e7e1a15-f043-4ea0-9bb6-caf813202c32" returned: 0 in 0.885s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-quobyte-4e7e1a15-f043-4ea0-9bb6-caf813202c32" released by "delete_volume" :: held 1.768s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Created reservations ['faa31eee-1a32-47ff-81a8-6f8c9098965e', '10fdeb39-f020-4ffb-bef7-b7decf092944', 'c6273f8d-f8e3-40d6-aef9-17bafeca9b35', 'efcff37f-ca91-46ca-a008-a36842a1bcd0'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:45 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:45 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "cinder-30979fc9-6865-4022-a30e-9cc5e0850258-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-30979fc9-6865-4022-a30e-9cc5e0850258-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "cinder-quobyte-30979fc9-6865-4022-a30e-9cc5e0850258" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-quobyte-30979fc9-6865-4022-a30e-9cc5e0850258" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d3ec30-132d-43cb-872d-c56e8f549385]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:46 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.772s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:46 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Deleted volume successfully.
Jun 16 18:43:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bcb6fa5b-14f4-4a5e-bbff-7e706e14918c tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-4e7e1a15-f043-4ea0-9bb6-caf813202c32-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:46 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258
Jun 16 18:43:46 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:47 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258" returned: 0 in 1.215s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:47 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258
Jun 16 18:43:47 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:47 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30979fc9-6865-4022-a30e-9cc5e0850258" returned: 0 in 0.683s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-quobyte-30979fc9-6865-4022-a30e-9cc5e0850258" released by "delete_volume" :: held 1.951s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:47 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Created reservations ['bf75068d-f268-45b3-990e-d2cea9060c0a', '79508693-4f00-40cf-ab9a-b4354aeded26', '0464c983-cc36-4148-8053-806fceb5ffa4', '032bcab2-5432-4f97-8c73-abd9be1fb031'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:48 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:48 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "cinder-3f73a124-ce83-4cd0-b5ec-e0042b015f78-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-3f73a124-ce83-4cd0-b5ec-e0042b015f78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "cinder-quobyte-3f73a124-ce83-4cd0-b5ec-e0042b015f78" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-quobyte-3f73a124-ce83-4cd0-b5ec-e0042b015f78" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[50378e97-f515-49c0-a8b3-0bd7ee6b4b2d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:48 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78
Jun 16 18:43:48 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:48 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.786s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Deleted volume successfully.
Jun 16 18:43:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a496760f-8ba2-4e5c-9770-9c1e4a13718f tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-30979fc9-6865-4022-a30e-9cc5e0850258-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:49 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78" returned: 0 in 0.800s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:49 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78
Jun 16 18:43:49 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:49 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3f73a124-ce83-4cd0-b5ec-e0042b015f78" returned: 0 in 0.683s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-quobyte-3f73a124-ce83-4cd0-b5ec-e0042b015f78" released by "delete_volume" :: held 1.537s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Created reservations ['d0c6de1e-ad7f-4e9f-aa08-e8c9c6a35fc3', '6e9ca162-36e1-4f25-8dec-a8728318cb3f', '98c82ec2-b6c7-43b0-9d58-aef1314d2621', '28c20693-dda4-45ed-a0fb-3e678ee6fe1a'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:50 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:43:50 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:50 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.670s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:50 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:43:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Deleted volume successfully.
Jun 16 18:43:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-11cd8950-1871-4546-8048-82b1ab8a2bfc tempest-AttachVolumeTestJSON-1918294011 None] Lock "cinder-3f73a124-ce83-4cd0-b5ec-e0042b015f78-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Flow 'volume_create_manager' (e1ec4e7f-19c3-4202-9e93-538bf0e82e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cafeb6-1536-4d94-b01a-e74f66f8a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cafeb6-1536-4d94-b01a-e74f66f8a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-659170612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3524f316-15b2-420b-b418-854c78dd3d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b168d6662b5e4c24b0bd94f37b71866e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:58Z,use_quota=True,user_id='77a12e058b294b919415bf91853e5510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18073a65-5589-4eec-9617-4272316d1480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18073a65-5589-4eec-9617-4272316d1480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85b04bd-b2cc-4f04-b5ff-654ff2521a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85b04bd-b2cc-4f04-b5ff-654ff2521a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3524f316-15b2-420b-b418-854c78dd3d77', 'volume_name': 'volume-3524f316-15b2-420b-b418-854c78dd3d77', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccaca32-18a2-4e07-9a2b-0f95948603ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccaca32-18a2-4e07-9a2b-0f95948603ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f53ee6-6069-4446-9858-1c5701b4fc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:57 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Volume 3524f316-15b2-420b-b418-854c78dd3d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3524f316-15b2-420b-b418-854c78dd3d77', 'volume_size': 1}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-659170612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3524f316-15b2-420b-b418-854c78dd3d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b168d6662b5e4c24b0bd94f37b71866e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:58Z,use_quota=True,user_id='77a12e058b294b919415bf91853e5510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Creating volume 3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:43:57 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:43:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:57 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 1073741824
Jun 16 18:43:57 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Flow 'volume_create_manager' (a4afff3e-9b57-4ea5-a42e-933d2be55b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dd5cb5-010e-4699-8057-fab7d1756594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:58 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dd5cb5-010e-4699-8057-fab7d1756594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-830171405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669c700a-286f-4596-8445-dd5f073045b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668676ca0374e229df63cc4c7ac7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:59Z,use_quota=True,user_id='c54782d709ab42ca9a4e894efca6fd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ce1f55-89d7-4acf-9fc5-99672470ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ce1f55-89d7-4acf-9fc5-99672470ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b32de4-0f3c-48fc-a8db-027f070d0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b32de4-0f3c-48fc-a8db-027f070d0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669c700a-286f-4596-8445-dd5f073045b5', 'volume_name': 'volume-669c700a-286f-4596-8445-dd5f073045b5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42729c01-fbe7-4179-982a-670f9de5f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42729c01-fbe7-4179-982a-670f9de5f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766239f6-f147-4a74-bd51-bf823bf547b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Volume 669c700a-286f-4596-8445-dd5f073045b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669c700a-286f-4596-8445-dd5f073045b5', 'volume_size': 1}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 1073741824" returned: 0 in 0.905s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:58 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77
Jun 16 18:43:58 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:59 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77" returned: 0 in 0.639s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-830171405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669c700a-286f-4596-8445-dd5f073045b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668676ca0374e229df63cc4c7ac7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:43:59Z,use_quota=True,user_id='c54782d709ab42ca9a4e894efca6fd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Creating volume 669c700a-286f-4596-8445-dd5f073045b5 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:43:59 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:43:59 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 1073741824
Jun 16 18:43:59 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f53ee6-6069-4446-9858-1c5701b4fc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3524f316-15b2-420b-b418-854c78dd3d77', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9802dad9-0662-4f5b-94a0-20f1c569c1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:43:59 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Volume volume-3524f316-15b2-420b-b418-854c78dd3d77 (3524f316-15b2-420b-b418-854c78dd3d77): created successfully
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9802dad9-0662-4f5b-94a0-20f1c569c1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:43:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Flow 'volume_create_manager' (e1ec4e7f-19c3-4202-9e93-538bf0e82e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:43:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-6334470f-615f-4400-8897-7a9a7a9116a3 req-707a6b2c-f6dc-4dc4-967d-0729e9d79a09 tempest-VolumesSnapshotsTestJSON-1980050498 None] Created volume successfully.
Jun 16 18:44:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:00 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 1073741824" returned: 0 in 0.946s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:00 devstack sudo[100911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5
Jun 16 18:44:00 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:01 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5" returned: 0 in 0.670s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Creating offline snapshot d161ef21-3349-45a0-b211-38452dba2842 of volume 3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766239f6-f147-4a74-bd51-bf823bf547b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669c700a-286f-4596-8445-dd5f073045b5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593ddb42-42c1-4f2d-897e-d956ac729a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[96342dc5-ac08-4b24-8825-600c819c3b57]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:01 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Volume volume-669c700a-286f-4596-8445-dd5f073045b5 (669c700a-286f-4596-8445-dd5f073045b5): created successfully
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593ddb42-42c1-4f2d-897e-d956ac729a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Flow 'volume_create_manager' (a4afff3e-9b57-4ea5-a42e-933d2be55b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:44:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-95083afe-e4b9-4543-8127-05b0edd34198 tempest-AttachVolumeNegativeTest-843500524 None] Created volume successfully.
Jun 16 18:44:01 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77
Jun 16 18:44:01 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:02 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77" returned: 0 in 0.828s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:02 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 1G
Jun 16 18:44:02 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:02 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 1G" returned: 0 in 0.815s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3524f316-15b2-420b-b418-854c78dd3d77 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:02 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3524f316-15b2-420b-b418-854c78dd3d77 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842
Jun 16 18:44:02 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:03 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3524f316-15b2-420b-b418-854c78dd3d77 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842" returned: 0 in 0.671s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:03 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 is being set with open permissions: ugo+rw
Jun 16 18:44:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:03 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842
Jun 16 18:44:03 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:04 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842" returned: 0 in 0.683s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:04 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info
Jun 16 18:44:04 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:04 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:04 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info is being set with open permissions: ugo+rw
Jun 16 18:44:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:04 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info
Jun 16 18:44:04 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:05 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.info" returned: 0 in 0.646s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.366s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.516s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c396a89-7d6f-4a35-bbc9-cc86d363d031]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-067b2b30-24aa-495d-af48-02333e90657f req-e915e1a3-074b-46b7-8a00-8d7319e29317 tempest-VolumesSnapshotsTestJSON-1980050498 None] Create snapshot completed successfully
Jun 16 18:44:05 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5
Jun 16 18:44:05 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "cinder-d161ef21-3349-45a0-b211-38452dba2842-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-d161ef21-3349-45a0-b211-38452dba2842-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "cinder-quobyte-3524f316-15b2-420b-b418-854c78dd3d77" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-quobyte-3524f316-15b2-420b-b418-854c78dd3d77" acquired by "delete_snapshot" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "cinder-quobyte-d161ef21-3349-45a0-b211-38452dba2842" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-quobyte-d161ef21-3349-45a0-b211-38452dba2842" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Deleting offline snapshot d161ef21-3349-45a0-b211-38452dba2842 of volume 3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] snapshot_file for this snap is: volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacbc07f-b02c-4a37-97d1-d66711d2c92f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:06 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842
Jun 16 18:44:06 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:06 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5" returned: 0 in 0.788s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-669c700a-286f-4596-8445-dd5f073045b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21630fbd-6d75-4c7e-8197-ff7462cd80ba', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=75,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=23 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:44:06 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-b56cb939-f48d-49d2-8d24-ea381039d412 req-5f9c4110-d92a-4427-990f-72c9b2e4b3ce tempest-AttachVolumeNegativeTest-843500524 None] attachment_update completed successfully.
Jun 16 18:44:06 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842" returned: 0 in 0.857s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3524f316-15b2-420b-b418-854c78dd3d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1baaeca-941c-404d-b7b5-a7ceeea716ae]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:06 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77
Jun 16 18:44:06 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:07 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77" returned: 0 in 0.812s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:07 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842
Jun 16 18:44:07 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:08 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:08 devstack sudo[101351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842
Jun 16 18:44:08 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:09 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77.d161ef21-3349-45a0-b211-38452dba2842" returned: 0 in 0.638s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-quobyte-d161ef21-3349-45a0-b211-38452dba2842" released by "_delete_snapshot" :: held 3.240s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-quobyte-3524f316-15b2-420b-b418-854c78dd3d77" released by "delete_snapshot" :: held 3.279s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:09 devstack cinder-volume[91851]: DEBUG cinder.quota [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Created reservations ['2a844750-62a7-43b9-b4ed-cfab614aa2da', '8bbf3b0d-a23e-4128-835f-6a081d048b34', '9b56e18b-b32e-414f-b8b5-02f39abee486', 'da1b514b-ffe9-4896-a523-25815e32d3da'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:44:09 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Delete snapshot completed successfully.
Jun 16 18:44:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-0ee05d1f-1172-4663-aa9a-92b06f5f7369 req-0986a050-6158-428f-9bba-f9fd168f178e tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-d161ef21-3349-45a0-b211-38452dba2842-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "cinder-3524f316-15b2-420b-b418-854c78dd3d77-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-3524f316-15b2-420b-b418-854c78dd3d77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "cinder-quobyte-3524f316-15b2-420b-b418-854c78dd3d77" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-quobyte-3524f316-15b2-420b-b418-854c78dd3d77" acquired by "delete_volume" :: waited 0.036s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:10 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5a87fc-ebfb-488c-b981-8d75738c5177]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:10 devstack sudo[101358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77
Jun 16 18:44:10 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:11 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77" returned: 0 in 0.824s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:11 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77
Jun 16 18:44:11 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:12 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3524f316-15b2-420b-b418-854c78dd3d77" returned: 0 in 0.733s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-quobyte-3524f316-15b2-420b-b418-854c78dd3d77" released by "delete_volume" :: held 1.645s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG cinder.quota [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Created reservations ['c2578b28-6fba-4f5f-8d3b-9104f5a4e5b0', '38b00e84-d7b2-4fd7-ba3b-d80ba0043f74', '6c937f11-3e52-40cb-b776-8f4d6338c566', '0445b933-b7ec-4a6d-8b96-f2d1e4ef7d30'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:12 devstack sudo[101366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:44:12 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:13 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:13 devstack cinder-volume[91851]: DEBUG cinder.manager [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:44:13 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Deleted volume successfully.
Jun 16 18:44:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [req-8085464a-94aa-43c2-add5-2d0e5ea194ca req-cf9e1be3-b348-4aca-93e6-ddc05dde2b4f tempest-VolumesSnapshotsTestJSON-1980050498 None] Lock "cinder-3524f316-15b2-420b-b418-854c78dd3d77-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:16 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=74,cinder:SELECT=77,cinder:INSERT=22,cinder:DELETE=5 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:44:16 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:44:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Flow 'volume_create_manager' (287338ff-f714-4a52-ac0b-be440e76584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:44:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeddeace-ce74-444d-b9a6-d402278e9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeddeace-ce74-444d-b9a6-d402278e9305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-767465379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f952ea5a-6806-47be-90c4-d61151968ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe685b8135804d39818ce1ebc9038a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:44:17Z,use_quota=True,user_id='7052b53060274f97930d626f79a0b826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5597bdb6-8349-46c7-b960-d98675008b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5597bdb6-8349-46c7-b960-d98675008b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a32349-0beb-4f3c-a54c-d37b904adae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a32349-0beb-4f3c-a54c-d37b904adae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f952ea5a-6806-47be-90c4-d61151968ebe', 'volume_name': 'volume-f952ea5a-6806-47be-90c4-d61151968ebe', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf006208-252c-48ab-8859-93baa6fd35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf006208-252c-48ab-8859-93baa6fd35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b950facd-4463-4135-934e-a8514295dbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Volume f952ea5a-6806-47be-90c4-d61151968ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f952ea5a-6806-47be-90c4-d61151968ebe', 'volume_size': 1}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-767465379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f952ea5a-6806-47be-90c4-d61151968ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe685b8135804d39818ce1ebc9038a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:44:17Z,use_quota=True,user_id='7052b53060274f97930d626f79a0b826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Creating volume f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:44:17 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:44:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:17 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe 1073741824
Jun 16 18:44:17 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:18 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe 1073741824" returned: 0 in 1.007s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:18 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:44:18 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:18 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 0.668s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b950facd-4463-4135-934e-a8514295dbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f952ea5a-6806-47be-90c4-d61151968ebe', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b803f3fa-7e36-47cc-b242-69bb6456cbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Volume volume-f952ea5a-6806-47be-90c4-d61151968ebe (f952ea5a-6806-47be-90c4-d61151968ebe): created successfully
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b803f3fa-7e36-47cc-b242-69bb6456cbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Flow 'volume_create_manager' (287338ff-f714-4a52-ac0b-be440e76584d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:44:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2ff979cc-b0da-406c-8544-06d7c1f42fdd tempest-TestStampPattern-267273018 None] Created volume successfully.
Jun 16 18:44:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fa912aa4-d808-48ed-8827-0b36d63ef61e tempest-GroupsV314Test-1554648530 None] Group tempest-GroupsV314Test-Group-29000722: creating
Jun 16 18:44:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fa912aa4-d808-48ed-8827-0b36d63ef61e tempest-GroupsV314Test-1554648530 None] Group tempest-GroupsV314Test-Group-29000722: created successfully
Jun 16 18:44:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fa912aa4-d808-48ed-8827-0b36d63ef61e tempest-GroupsV314Test-1554648530 None] Create group completed successfully.
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Flow 'volume_create_manager' (d1627e9b-87f8-4175-809c-59b4fc829d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e93421e-e7d7-403c-87d3-b2cf3a9b90ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e93421e-e7d7-403c-87d3-b2cf3a9b90ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1227900596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9a69b834-0497-4759-aa29-022f994d5fdd,host='devstack@QuobyteHD#QuobyteHD',id=361bd6d0-d95c-4784-a60a-9fd19bdc3334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589fecbb63064a15adbaf8aa1bb0de6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:44:23Z,use_quota=True,user_id='ad4e9156fd1547ea9c6ad06e61ec304b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d9bc49d-33fc-4693-a379-e1976299e650),volume_type_id=9d9bc49d-33fc-4693-a379-e1976299e650)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22626f1f-7954-42da-aa4c-51d118d2a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22626f1f-7954-42da-aa4c-51d118d2a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9e6071-783b-4e5e-9796-3c9fe849050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9e6071-783b-4e5e-9796-3c9fe849050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361bd6d0-d95c-4784-a60a-9fd19bdc3334', 'volume_name': 'volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c133cbfd-880f-4583-aeac-bf32f9a6f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c133cbfd-880f-4583-aeac-bf32f9a6f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b438f25-2e49-4eab-beb5-47a34932312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:22 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Volume 361bd6d0-d95c-4784-a60a-9fd19bdc3334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334', 'volume_size': 1}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9a69b834-0497-4759-aa29-022f994d5fdd,created_at=2026-06-16T16:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1227900596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9a69b834-0497-4759-aa29-022f994d5fdd,host='devstack@QuobyteHD#QuobyteHD',id=361bd6d0-d95c-4784-a60a-9fd19bdc3334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589fecbb63064a15adbaf8aa1bb0de6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:44:23Z,use_quota=True,user_id='ad4e9156fd1547ea9c6ad06e61ec304b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d9bc49d-33fc-4693-a379-e1976299e650),volume_type_id=9d9bc49d-33fc-4693-a379-e1976299e650)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Creating volume 361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:44:22 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:44:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:22 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 1073741824
Jun 16 18:44:22 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:23 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 1073741824" returned: 0 in 0.875s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:23 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:23 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:24 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 0.711s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b438f25-2e49-4eab-beb5-47a34932312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe79e7c-3bc5-4f4b-9038-28437a543cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:24 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Volume volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 (361bd6d0-d95c-4784-a60a-9fd19bdc3334): created successfully
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe79e7c-3bc5-4f4b-9038-28437a543cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Flow 'volume_create_manager' (d1627e9b-87f8-4175-809c-59b4fc829d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:44:24 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-545b9aac-6ee8-4bf8-9e12-48ab5a9a07c4 tempest-GroupsV314Test-1554648530 None] Created volume successfully.
Jun 16 18:44:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:25 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Cloning volume 361bd6d0-d95c-4784-a60a-9fd19bdc3334 to volume b336db36-6915-41f0-9281-ef55fd66748e
Jun 16 18:44:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Creating offline snapshot a651f6c1-1921-47be-bdb4-64d25c07dfbf of volume 361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:44:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[539d6d80-767a-4e39-9fa3-b2a679fb51c6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:26 devstack sudo[101471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:26 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:26 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:26 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf 1G
Jun 16 18:44:26 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:27 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf 1G" returned: 0 in 0.998s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:27 devstack sudo[101541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf
Jun 16 18:44:27 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:28 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf" returned: 0 in 0.774s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:28 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:44:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:28 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf
Jun 16 18:44:28 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:29 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf" returned: 0 in 0.657s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:29 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info
Jun 16 18:44:29 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:30 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info" returned: 0 in 1.093s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:30 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:44:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:30 devstack sudo[101610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info
Jun 16 18:44:30 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:31 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.info" returned: 0 in 1.052s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Acquiring lock "cinder-quobyte-b336db36-6915-41f0-9281-ef55fd66748e" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-b336db36-6915-41f0-9281-ef55fd66748e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] snapshot: a651f6c1-1921-47be-bdb4-64d25c07dfbf, volume: b336db36-6915-41f0-9281-ef55fd66748e,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa3fa7-274e-47f6-8f2a-1194b4f973e3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:31 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf
Jun 16 18:44:31 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:32 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf" returned: 0 in 0.804s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:44:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:44:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:44:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4256f5c-842d-421f-b248-bf1e880747a4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:32 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:32 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:33 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 1.274s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:33 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:44:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:33 devstack sudo[101633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e
Jun 16 18:44:33 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:39 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:44:39 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:42 devstack sudo[101670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:44:42 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:42 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e" returned: 0 in 9.272s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac90920-8952-4465-85c6-0bee07711069]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:43 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:43 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:43 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.468s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:44:43 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:44:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:44:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:44:44 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 1.280s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:44:44 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Converted 1024.00 MB image at 110.37 MB/s
Jun 16 18:44:44 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:44 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e
Jun 16 18:44:44 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:44 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e" returned: 0 in 0.646s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-b336db36-6915-41f0-9281-ef55fd66748e" released by "_copy_volume_from_snapshot" :: held 13.373s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Acquiring lock "cinder-quobyte-a651f6c1-1921-47be-bdb4-64d25c07dfbf" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-a651f6c1-1921-47be-bdb4-64d25c07dfbf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Deleting offline snapshot a651f6c1-1921-47be-bdb4-64d25c07dfbf of volume 361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] snapshot_file for this snap is: volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccfacb7-9268-4682-8580-d149b1e58d58]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:45 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf
Jun 16 18:44:45 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:45 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:44:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d075d2-db49-4e4b-b3ec-031dc6240c34]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:45 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:45 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:46 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 0.721s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:46 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf
Jun 16 18:44:46 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:47 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf" returned: 0 in 0.758s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:47 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf
Jun 16 18:44:47 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:47 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334.a651f6c1-1921-47be-bdb4-64d25c07dfbf" returned: 0 in 0.637s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-a651f6c1-1921-47be-bdb4-64d25c07dfbf" released by "_delete_snapshot" :: held 2.988s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.881s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:47 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0373a2d1-70e1-4c9b-a7f1-a12ccd22568e tempest-GroupsV314Test-1554648530 None] Create group from source-group-9a69b834-0497-4759-aa29-022f994d5fdd completed successfully.
Jun 16 18:44:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Acquiring lock "cinder-quobyte-b336db36-6915-41f0-9281-ef55fd66748e" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-b336db36-6915-41f0-9281-ef55fd66748e" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a1bb5-c069-4081-8f63-b8ee7b72eab3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:48 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e
Jun 16 18:44:48 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:49 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e" returned: 0 in 0.808s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:49 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e
Jun 16 18:44:49 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:50 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b336db36-6915-41f0-9281-ef55fd66748e" returned: 0 in 0.584s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-b336db36-6915-41f0-9281-ef55fd66748e" released by "delete_volume" :: held 1.445s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Created reservations ['7319bcae-9e70-4951-9fe6-95dbce13d0aa'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:44:50 devstack cinder-volume[91851]: WARNING cinder.quota [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1163471850 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1163471850, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:44:50 devstack cinder-volume[91851]: WARNING cinder.quota [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1163471850 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1163471850, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Created reservations ['b9294586-e75d-4db8-9c89-fc5987280d12', '26a27cb0-bb93-4e8e-aa57-4fafddd7ad95', '11593fd1-52ee-4600-9b28-c165369f3913', '0ab790f4-537d-4f38-b571-3546d5730afd'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:50 devstack sudo[101770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:44:50 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:50 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:50 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:44:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-77c17228-0081-4f4c-a7ec-0519f6fa758b tempest-GroupsV314Test-1554648530 None] Delete group completed successfully.
Jun 16 18:44:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Acquiring lock "cinder-quobyte-361bd6d0-d95c-4784-a60a-9fd19bdc3334" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:44:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-361bd6d0-d95c-4784-a60a-9fd19bdc3334" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:44:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aaaaa4-04a7-413f-bc46-4baeb8f398f0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:44:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:51 devstack sudo[101773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:51 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:51 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:51 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334
Jun 16 18:44:51 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:52 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-361bd6d0-d95c-4784-a60a-9fd19bdc3334" returned: 0 in 0.589s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Lock "cinder-quobyte-361bd6d0-d95c-4784-a60a-9fd19bdc3334" released by "delete_volume" :: held 1.377s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Created reservations ['4b12a33b-dc29-480c-95ab-1374cb8843d5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Created reservations ['6ed97a2a-b1ac-451c-ae60-d4ebfe7ff64b', 'd3f70e6c-2860-4c2b-a490-ab5dbaa71ff3', 'de56eca8-a928-40a1-abf4-6adc1546bd52', '871469a3-23d8-45bc-ba97-b643aee99d17'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:52 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:44:52 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:53 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.571s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:53 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:44:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-acc139a9-5f82-4ad7-8e79-029682d3b391 tempest-GroupsV314Test-1554648530 None] Delete group completed successfully.
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Flow 'volume_create_manager' (5e3436f2-cdb1-4fe3-b9ea-e182d3f14838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194ba496-490b-455e-b864-528710c45315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194ba496-490b-455e-b864-528710c45315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1572313439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6602b871-2bf0-4b2e-ac77-50951add000b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bfc0048d2548cfbffad8ad2c28fb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:44:59Z,use_quota=True,user_id='8065f123c82f44e19deefbd162aa4cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21b3746-4ac0-4db4-addb-3da8942a5d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21b3746-4ac0-4db4-addb-3da8942a5d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529bfe23-0caa-4a7e-b4f9-0900b5c04610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529bfe23-0caa-4a7e-b4f9-0900b5c04610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6602b871-2bf0-4b2e-ac77-50951add000b', 'volume_name': 'volume-6602b871-2bf0-4b2e-ac77-50951add000b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfff23c1-1368-4cf6-9cfd-31a122d0a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfff23c1-1368-4cf6-9cfd-31a122d0a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4958d5e-da48-4634-9523-792380be2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:44:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Volume 6602b871-2bf0-4b2e-ac77-50951add000b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6602b871-2bf0-4b2e-ac77-50951add000b', 'volume_size': 1}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1572313439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6602b871-2bf0-4b2e-ac77-50951add000b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19bfc0048d2548cfbffad8ad2c28fb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:44:59Z,use_quota=True,user_id='8065f123c82f44e19deefbd162aa4cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Creating volume 6602b871-2bf0-4b2e-ac77-50951add000b {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:44:58 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:44:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:58 devstack sudo[101824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b 1073741824
Jun 16 18:44:58 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:44:59 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root
Jun 16 18:44:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b 1073741824" returned: 0 in 0.779s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:44:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:44:59 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b
Jun 16 18:44:59 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:00 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b" returned: 0 in 0.652s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4958d5e-da48-4634-9523-792380be2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6602b871-2bf0-4b2e-ac77-50951add000b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11feb8ac-7656-44c4-9466-520bb19123e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Volume volume-6602b871-2bf0-4b2e-ac77-50951add000b (6602b871-2bf0-4b2e-ac77-50951add000b): created successfully
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11feb8ac-7656-44c4-9466-520bb19123e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Flow 'volume_create_manager' (5e3436f2-cdb1-4fe3-b9ea-e182d3f14838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:45:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-901412ba-d17c-4ef9-8732-e78553daabbf tempest-VolumeQuotasNegativeTestJSON-89064733 None] Created volume successfully.
Jun 16 18:45:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Acquiring lock "cinder-6602b871-2bf0-4b2e-ac77-50951add000b-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:45:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "cinder-6602b871-2bf0-4b2e-ac77-50951add000b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:45:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Acquiring lock "cinder-quobyte-6602b871-2bf0-4b2e-ac77-50951add000b" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:45:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "cinder-quobyte-6602b871-2bf0-4b2e-ac77-50951add000b" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:45:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4993faf2-ce0e-405e-8a21-ee2a689e96fa]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:45:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:01 devstack sudo[101837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b
Jun 16 18:45:01 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:02 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b" returned: 0 in 0.784s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:02 devstack sudo[101842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b
Jun 16 18:45:02 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:03 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6602b871-2bf0-4b2e-ac77-50951add000b" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "cinder-quobyte-6602b871-2bf0-4b2e-ac77-50951add000b" released by "delete_volume" :: held 1.427s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Created reservations ['ec5a6224-7a70-480c-8b20-6574d06548d6', '346a39c9-42b3-4103-b47c-4d85de7f444b', '6a9e8bd1-f23d-4ee6-a2ac-691935764c09', '6f4bbe63-3a86-4b3e-a42c-40191cd84ba4'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:03 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:45:03 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-2a041926-27f7-4bd4-9096-eae0e5475136 req-cb49f717-5e3a-4a47-8f8d-1fc2aaa544d2 tempest-AttachVolumeNegativeTest-843500524 None] Terminate volume connection completed successfully.
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-2a041926-27f7-4bd4-9096-eae0e5475136 req-cb49f717-5e3a-4a47-8f8d-1fc2aaa544d2 tempest-AttachVolumeNegativeTest-843500524 None] Deleting attachment 21630fbd-6d75-4c7e-8197-ff7462cd80ba. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:45:03 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.612s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:45:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Deleted volume successfully.
Jun 16 18:45:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d035c44d-1b5e-47ce-81fc-ea60ab9cc82c tempest-VolumeQuotasNegativeTestJSON-89064733 None] Lock "cinder-6602b871-2bf0-4b2e-ac77-50951add000b-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:45:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce2601-e643-40d3-9b29-d88ef084bbc4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:45:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:08 devstack sudo[101904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:45:08 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:09 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 0.915s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-f952ea5a-6806-47be-90c4-d61151968ebe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13296ca4-5ab3-46cb-8af5-ed0aa1aaeb21', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:45:09 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-4a7edd88-6bfa-4a55-aeb8-d3d5cc8d4d40 req-9aeb4d47-28fb-4037-bd19-fd3a601de87a tempest-TestStampPattern-267273018 None] attachment_update completed successfully.
Jun 16 18:45:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-8074ff4b-9694-4aca-ba8c-ccbd1e8a5f63 req-192c1596-e089-4e22-8b9b-44260f09317a tempest-TestStampPattern-267273018 None] Terminate volume connection completed successfully.
Jun 16 18:45:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-8074ff4b-9694-4aca-ba8c-ccbd1e8a5f63 req-192c1596-e089-4e22-8b9b-44260f09317a tempest-TestStampPattern-267273018 None] Deleting attachment 13296ca4-5ab3-46cb-8af5-ed0aa1aaeb21. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:45:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Creating offline snapshot f8dede33-4bf5-46ac-8016-80ddd1518655 of volume f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:45:20 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a497c05-2f0d-4956-90b4-66c20ab65ac0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:45:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:21 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:45:21 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:21 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 0.789s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:21 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 1G
Jun 16 18:45:21 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:22 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 1G" returned: 0 in 0.808s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f952ea5a-6806-47be-90c4-d61151968ebe -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:22 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f952ea5a-6806-47be-90c4-d61151968ebe -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655
Jun 16 18:45:22 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:23 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f952ea5a-6806-47be-90c4-d61151968ebe -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655" returned: 0 in 0.887s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:23 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 is being set with open permissions: ugo+rw
Jun 16 18:45:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:23 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655
Jun 16 18:45:23 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:24 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655" returned: 0 in 0.643s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:24 devstack sudo[102373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info
Jun 16 18:45:24 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:24 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info" returned: 0 in 0.770s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:24 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info is being set with open permissions: ugo+rw
Jun 16 18:45:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:24 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info
Jun 16 18:45:24 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:25 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.info" returned: 0 in 0.666s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.682s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a62f0ea3-00d3-4951-b3b1-6ce629bc1fed tempest-TestStampPattern-267273018 None] Create snapshot completed successfully
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Flow 'volume_create_manager' (9f67a8f0-1614-4764-ba75-cd737cbd1792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2ca1a1-b9cc-405d-9a34-4be8a48f22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2ca1a1-b9cc-405d-9a34-4be8a48f22fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350472536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfcceed-afea-44f1-a888-682942e1148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55849d1918374afd8c911c6c72f768a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:45:27Z,use_quota=True,user_id='e1d05e871337476ba519cca3ffdd9620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf64e4b1-bde2-4bbf-a2fc-e0923a485431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf64e4b1-bde2-4bbf-a2fc-e0923a485431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf46292-a2c5-42ce-8242-157e13ec81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf46292-a2c5-42ce-8242-157e13ec81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfcceed-afea-44f1-a888-682942e1148a', 'volume_name': 'volume-4cfcceed-afea-44f1-a888-682942e1148a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07222609-c5f1-4538-b0f5-eb47a769479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07222609-c5f1-4538-b0f5-eb47a769479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d031365-f02b-44ff-bd61-60933fd86499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:27 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Volume 4cfcceed-afea-44f1-a888-682942e1148a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfcceed-afea-44f1-a888-682942e1148a', 'volume_size': 1}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350472536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfcceed-afea-44f1-a888-682942e1148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55849d1918374afd8c911c6c72f768a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:45:27Z,use_quota=True,user_id='e1d05e871337476ba519cca3ffdd9620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Creating volume 4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:45:27 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:45:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:27 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a 1073741824
Jun 16 18:45:27 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:28 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a 1073741824" returned: 0 in 0.864s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:28 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:45:28 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:29 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d031365-f02b-44ff-bd61-60933fd86499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfcceed-afea-44f1-a888-682942e1148a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82035b98-fcca-4d97-93e2-d323b32b8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:29 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Volume volume-4cfcceed-afea-44f1-a888-682942e1148a (4cfcceed-afea-44f1-a888-682942e1148a): created successfully
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82035b98-fcca-4d97-93e2-d323b32b8836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Flow 'volume_create_manager' (9f67a8f0-1614-4764-ba75-cd737cbd1792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:45:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-293cadef-d474-4b88-b1de-91451cff66f8 tempest-VolumesActionsTest-451689348 None] Created volume successfully.
Jun 16 18:45:36 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:45:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Flow 'volume_create_manager' (1f6f2303-7259-4a01-98e2-cf517d3f52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:45:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eb7470-7709-40af-8908-34bc87a2abd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eb7470-7709-40af-8908-34bc87a2abd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-972804625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf3770e-218e-4d10-9df2-ba9ed39c30d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe685b8135804d39818ce1ebc9038a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f8dede33-4bf5-46ac-8016-80ddd1518655,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:45:37Z,use_quota=True,user_id='7052b53060274f97930d626f79a0b826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d296e5-e4d5-4143-9a0c-78981dc307ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d296e5-e4d5-4143-9a0c-78981dc307ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b57bc04-f877-4ef8-b174-58f11930dc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b57bc04-f877-4ef8-b174-58f11930dc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adf3770e-218e-4d10-9df2-ba9ed39c30d3', 'volume_name': 'volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3', 'volume_size': 1, 'snapshot_id': 'f8dede33-4bf5-46ac-8016-80ddd1518655'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92fffe3-9e6d-4314-9343-d8b2a1396afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92fffe3-9e6d-4314-9343-d8b2a1396afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cc3628-bbd4-419e-86d1-7e8c564ea717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Volume adf3770e-218e-4d10-9df2-ba9ed39c30d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3', 'volume_size': 1, 'snapshot_id': 'f8dede33-4bf5-46ac-8016-80ddd1518655'}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-quobyte-f8dede33-4bf5-46ac-8016-80ddd1518655-adf3770e-218e-4d10-9df2-ba9ed39c30d3" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f8dede33-4bf5-46ac-8016-80ddd1518655-adf3770e-218e-4d10-9df2-ba9ed39c30d3" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Creating volume adf3770e-218e-4d10-9df2-ba9ed39c30d3 from snapshot f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-quobyte-adf3770e-218e-4d10-9df2-ba9ed39c30d3" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-adf3770e-218e-4d10-9df2-ba9ed39c30d3" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] snapshot: f8dede33-4bf5-46ac-8016-80ddd1518655, volume: adf3770e-218e-4d10-9df2-ba9ed39c30d3,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0070e13d-26a0-4301-a702-d1a477acda0f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:45:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:37 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655
Jun 16 18:45:37 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:38 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655" returned: 0 in 1.122s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f952ea5a-6806-47be-90c4-d61151968ebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:45:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:45:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:45:38 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb167c-fd37-46f4-91da-76765cc6b720]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:45:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:38 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:45:38 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:39 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 1.083s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:39 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:45:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:39 devstack sudo[102584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3
Jun 16 18:45:39 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:42 devstack sudo[102601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:45:42 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:45 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 3.262s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:45 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:45:45 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:45:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:45:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:45:47 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=47,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:45:47 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=49,cinder:SELECT=38,cinder:INSERT=7,cinder:DELETE=3 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:45:49 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3" returned: 0 in 10.225s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[932ea3a1-6b2e-42da-8035-0558889077d8]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:45:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:50 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:45:50 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7b589f11-515f-4396-947d-2ce7b3634f9f tempest-VolumesActionsTest-451689348 None] Acquiring lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a" by "attach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:45:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7b589f11-515f-4396-947d-2ce7b3634f9f tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a" acquired by "attach_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:45:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7b589f11-515f-4396-947d-2ce7b3634f9f tempest-VolumesActionsTest-451689348 None] Attaching volume 4cfcceed-afea-44f1-a888-682942e1148a to instance 363f2c85-24b7-4ac7-88d8-d90901b9520c at mountpoint /dev/vdb on host None.
Jun 16 18:45:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7b589f11-515f-4396-947d-2ce7b3634f9f tempest-VolumesActionsTest-451689348 None] Attach volume completed successfully.
Jun 16 18:45:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7b589f11-515f-4396-947d-2ce7b3634f9f tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a" released by "attach_volume" :: held 0.377s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:45:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a2f4c59b-86e3-41dd-9fd6-9129ab2ee331 tempest-VolumesActionsTest-451689348 None] Acquiring lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-detach_volume" by "detach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:45:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a2f4c59b-86e3-41dd-9fd6-9129ab2ee331 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:45:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a2f4c59b-86e3-41dd-9fd6-9129ab2ee331 tempest-VolumesActionsTest-451689348 None] Detaching volume 4cfcceed-afea-44f1-a888-682942e1148a from instance 363f2c85-24b7-4ac7-88d8-d90901b9520c.
Jun 16 18:45:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a2f4c59b-86e3-41dd-9fd6-9129ab2ee331 tempest-VolumesActionsTest-451689348 None] Detach volume completed successfully.
Jun 16 18:45:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a2f4c59b-86e3-41dd-9fd6-9129ab2ee331 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:45:51 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 1.808s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:51 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe, size 1024.00 MB, duration 10.23 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:45:51 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Converted 1024.00 MB image at 100.13 MB/s
Jun 16 18:45:51 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 is being set with open permissions: ugo+rw
Jun 16 18:45:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:51 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3
Jun 16 18:45:51 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:52 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3" returned: 0 in 0.853s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-adf3770e-218e-4d10-9df2-ba9ed39c30d3" released by "_copy_volume_from_snapshot" :: held 15.274s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f8dede33-4bf5-46ac-8016-80ddd1518655-adf3770e-218e-4d10-9df2-ba9ed39c30d3" released by "_create_volume_from_snapshot" :: held 15.340s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.375s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cc3628-bbd4-419e-86d1-7e8c564ea717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3', 'volume_size': 1, 'snapshot_id': 'f8dede33-4bf5-46ac-8016-80ddd1518655'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5c66a0-89be-4532-aff5-032a97a3f9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:52 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Volume volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 (adf3770e-218e-4d10-9df2-ba9ed39c30d3): created successfully
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5c66a0-89be-4532-aff5-032a97a3f9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Flow 'volume_create_manager' (1f6f2303-7259-4a01-98e2-cf517d3f52f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:45:52 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4486c6fd-9758-424f-9a33-5a1f00354455 tempest-TestStampPattern-267273018 None] Created volume successfully.
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Flow 'volume_create_manager' (9d969a2f-8fad-4115-b25e-549d20f94d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4567343-3e9d-4817-b521-557d7d57bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4567343-3e9d-4817-b521-557d7d57bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1521938355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b32d4e3-c8b3-495c-972d-b76799d0a642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668676ca0374e229df63cc4c7ac7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:45:59Z,use_quota=True,user_id='c54782d709ab42ca9a4e894efca6fd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d1446d-715b-4463-8e1b-f747b4b7bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d1446d-715b-4463-8e1b-f747b4b7bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc538ee8-497d-4212-a8f7-d273c94392d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc538ee8-497d-4212-a8f7-d273c94392d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b32d4e3-c8b3-495c-972d-b76799d0a642', 'volume_name': 'volume-6b32d4e3-c8b3-495c-972d-b76799d0a642', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee52f4-e45c-44b8-b005-357a56fce9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbee52f4-e45c-44b8-b005-357a56fce9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637153a8-e213-4df2-a1b0-e144bb9c5621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:45:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Volume 6b32d4e3-c8b3-495c-972d-b76799d0a642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b32d4e3-c8b3-495c-972d-b76799d0a642', 'volume_size': 1}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1521938355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b32d4e3-c8b3-495c-972d-b76799d0a642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668676ca0374e229df63cc4c7ac7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:45:59Z,use_quota=True,user_id='c54782d709ab42ca9a4e894efca6fd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Creating volume 6b32d4e3-c8b3-495c-972d-b76799d0a642 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:45:58 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:45:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:59 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 1073741824
Jun 16 18:45:59 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:45:59 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Jun 16 18:45:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 1073741824" returned: 0 in 0.901s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:45:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:45:59 devstack sudo[102847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642
Jun 16 18:45:59 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:00 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642" returned: 0 in 0.876s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637153a8-e213-4df2-a1b0-e144bb9c5621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b32d4e3-c8b3-495c-972d-b76799d0a642', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f18d108-7a24-4806-834d-b250095bac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:46:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Volume volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 (6b32d4e3-c8b3-495c-972d-b76799d0a642): created successfully
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f18d108-7a24-4806-834d-b250095bac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:46:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Flow 'volume_create_manager' (9d969a2f-8fad-4115-b25e-549d20f94d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:46:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-074f37fc-9da1-479f-b350-c438ad7f17be tempest-AttachVolumeNegativeTest-843500524 None] Created volume successfully.
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139836b-c711-459b-a056-88f3a851f146]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:04 devstack sudo[102863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642
Jun 16 18:46:04 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:04 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642" returned: 0 in 0.743s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:46:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-6b32d4e3-c8b3-495c-972d-b76799d0a642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0932ba3c-6079-4469-9733-00fe448a4bee', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:46:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-ddc9b0bf-f95a-4b2d-a00e-86d810bf3fdd req-7d9e231b-b7a6-4209-83e6-73d191585489 tempest-AttachVolumeNegativeTest-843500524 None] attachment_update completed successfully.
Jun 16 18:46:11 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-24bf2127-baea-4e9b-aa0a-4b055b15b4ef req-70e81f85-a851-40dd-9cb4-c1a5cc21b739 tempest-AttachVolumeNegativeTest-843500524 None] Terminate volume connection completed successfully.
Jun 16 18:46:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-24bf2127-baea-4e9b-aa0a-4b055b15b4ef req-70e81f85-a851-40dd-9cb4-c1a5cc21b739 tempest-AttachVolumeNegativeTest-843500524 None] Deleting attachment 0932ba3c-6079-4469-9733-00fe448a4bee. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:46:15 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:46:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0dd6744-14a5-4b2b-8d0f-7f3149966e48 tempest-VolumesActionsTest-451689348 None] Acquiring lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a" by "attach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:46:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0dd6744-14a5-4b2b-8d0f-7f3149966e48 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a" acquired by "attach_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:46:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d0dd6744-14a5-4b2b-8d0f-7f3149966e48 tempest-VolumesActionsTest-451689348 None] Attaching volume 4cfcceed-afea-44f1-a888-682942e1148a to instance daa59f99-89ad-4e3d-abfa-d68f44892672 at mountpoint /dev/vdb on host None.
Jun 16 18:46:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d0dd6744-14a5-4b2b-8d0f-7f3149966e48 tempest-VolumesActionsTest-451689348 None] Attach volume completed successfully.
Jun 16 18:46:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0dd6744-14a5-4b2b-8d0f-7f3149966e48 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a" released by "attach_volume" :: held 0.087s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:46:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fb8c1dc-5b4f-444f-b745-23a9584e3483 tempest-VolumesActionsTest-451689348 None] Acquiring lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-detach_volume" by "detach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:46:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fb8c1dc-5b4f-444f-b745-23a9584e3483 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:46:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2fb8c1dc-5b4f-444f-b745-23a9584e3483 tempest-VolumesActionsTest-451689348 None] Detaching volume 4cfcceed-afea-44f1-a888-682942e1148a from instance daa59f99-89ad-4e3d-abfa-d68f44892672.
Jun 16 18:46:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2fb8c1dc-5b4f-444f-b745-23a9584e3483 tempest-VolumesActionsTest-451689348 None] Detach volume completed successfully.
Jun 16 18:46:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2fb8c1dc-5b4f-444f-b745-23a9584e3483 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1917664-9043-4bd8-abaa-555419992ada]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:26 devstack sudo[103458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:46:26 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:46:26 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.809s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f3df45-1aa0-4a98-afe9-7ef4c3b9597c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:27 devstack sudo[103500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:46:27 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:27 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.767s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.18e0e404-16b7-43e7-9cee-118a57037b1am9bnh9lu.img {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:27 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.18e0e404-16b7-43e7-9cee-118a57037b1am9bnh9lu.img
Jun 16 18:46:27 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:32 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.18e0e404-16b7-43e7-9cee-118a57037b1am9bnh9lu.img" returned: 0 in 5.262s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec797c8-0995-4b15-8b27-06054b74177b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:33 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:46:33 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:33 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.890s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:33 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.18e0e404-16b7-43e7-9cee-118a57037b1am9bnh9lu.img {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:46:33 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Converted 1024.00 MB image at 194.55 MB/s
Jun 16 18:46:33 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] 18e0e404-16b7-43e7-9cee-118a57037b1a was raw, no need to convert to raw {{(pid=91851) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:46:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:42 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:46:42 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:46:43 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.016s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:46:43 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:46:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:46:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:46:53 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:46:53 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:46:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.296s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:46:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Uploaded volume to glance image-id: 18e0e404-16b7-43e7-9cee-118a57037b1a. {{(pid=91851) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}}
Jun 16 18:46:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.346s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:46:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a81cd58-d7fe-4091-9beb-c5f151ca7117]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d5a06778-f256-469c-870d-e5584f030001 tempest-VolumesActionsTest-451689348 None] Copy volume to image completed successfully.
Jun 16 18:46:55 devstack sudo[103679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3
Jun 16 18:46:55 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:56 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3" returned: 0 in 0.777s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:46:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4e977cc-036a-4c69-be20-018e84d333e9', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:46:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-edfadc4a-35ae-4737-838e-af23708f87dd req-e8d8e947-6c49-40e9-91f5-8309c31121e7 tempest-TestStampPattern-267273018 None] attachment_update completed successfully.
Jun 16 18:46:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:46:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:46:57 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab98a1-3b70-4b72-834b-34fe8560bf6a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:57 devstack sudo[103751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:46:57 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:58 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd8b21-7ef3-4937-ba8c-db23b26ba813]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:46:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:58 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:46:58 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:46:58 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Jun 16 18:46:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.697s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:46:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:46:58 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img
Jun 16 18:46:58 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:03 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img" returned: 0 in 5.252s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5baa12-c760-4bbd-89a1-71a25aea2ec0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:04 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:47:04 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Flow 'volume_create_manager' (b4cb665a-ec0c-4861-8032-6640dbc0188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9ab08b-5cac-420b-949e-ada6bc88b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9ab08b-5cac-420b-949e-ada6bc88b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-782590500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668676ca0374e229df63cc4c7ac7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:04Z,use_quota=True,user_id='c54782d709ab42ca9a4e894efca6fd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80728757-048f-4d4d-9265-ed4f879cff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80728757-048f-4d4d-9265-ed4f879cff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0528617-ccdb-4955-99f7-3ce614b68277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0528617-ccdb-4955-99f7-3ce614b68277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d9c85e-4a4b-4f4b-b5fd-34cb53780d18', 'volume_name': 'volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823ec5d4-35f6-4974-802b-f91fc88a1ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823ec5d4-35f6-4974-802b-f91fc88a1ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6efa53-8ef9-4aa4-92e7-4bb3c44288c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:04 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Volume d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18', 'volume_size': 1}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-a3f02238-8ca6-4de8-9f84-a49436e6ffbd req-59788812-b24b-492a-8451-9188ecad4051 tempest-TestStampPattern-267273018 None] Terminate volume connection completed successfully.
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-a3f02238-8ca6-4de8-9f84-a49436e6ffbd req-59788812-b24b-492a-8451-9188ecad4051 tempest-TestStampPattern-267273018 None] Deleting attachment c4e977cc-036a-4c69-be20-018e84d333e9. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:47:04 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.910s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:47:04 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Converted 1024.00 MB image at 194.93 MB/s
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] e4993414-b758-4f54-80b9-d151ada76ab6 was raw, converting to qcow2 {{(pid=91851) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab1b79-2c61-4d98-b85d-fb92ab42fa59]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:05 devstack sudo[104144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img
Jun 16 18:47:05 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:05 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img" returned: 0 in 0.648s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:05 devstack sudo[104148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img
Jun 16 18:47:05 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:06 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img" returned: 1 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:06 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa
Jun 16 18:47:06 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:06 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa" returned: 0 in 0.586s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Image conversion details: src /opt/stack/data/cinder/conversion/4cfcceed-afea-44f1-a888-682942e1148a.temp_image.e4993414-b758-4f54-80b9-d151ada76ab6eayj6ga8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:47:06 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[357c20a9-bfdc-469f-91f0-e1c8f54a05f4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:06 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa
Jun 16 18:47:06 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:07 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ivuuemqa" returned: 0 in 0.682s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.716s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Uploaded volume to glance image-id: e4993414-b758-4f54-80b9-d151ada76ab6. {{(pid=91851) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.354s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-782590500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2668676ca0374e229df63cc4c7ac7ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:04Z,use_quota=True,user_id='c54782d709ab42ca9a4e894efca6fd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Creating volume d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:08 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:09 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 1073741824
Jun 16 18:47:09 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:09 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-cc1527a7-0b07-4e73-91fe-55d02eb44c3f tempest-VolumesActionsTest-451689348 None] Copy volume to image completed successfully.
Jun 16 18:47:09 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 1073741824" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:09 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18
Jun 16 18:47:09 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:10 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" returned: 0 in 0.688s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6efa53-8ef9-4aa4-92e7-4bb3c44288c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf03d98-feea-4f3d-9712-85db0dfaca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Volume volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 (d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18): created successfully
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf03d98-feea-4f3d-9712-85db0dfaca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Flow 'volume_create_manager' (b4cb665a-ec0c-4861-8032-6640dbc0188f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-109e5b6c-bba3-4631-975f-db60df39eb70 tempest-AttachVolumeNegativeTest-843500524 None] Created volume successfully.
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Acquiring lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Acquiring lock "cinder-quobyte-4cfcceed-afea-44f1-a888-682942e1148a" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Lock "cinder-quobyte-4cfcceed-afea-44f1-a888-682942e1148a" acquired by "delete_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042832f-e1be-43db-a0e0-f40d561d45dc]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:10 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:47:10 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:11 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.713s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:11 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a
Jun 16 18:47:11 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:12 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4cfcceed-afea-44f1-a888-682942e1148a" returned: 0 in 0.639s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Lock "cinder-quobyte-4cfcceed-afea-44f1-a888-682942e1148a" released by "delete_volume" :: held 1.389s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Created reservations ['74dbc74f-2de9-465f-a823-164130c86006', '96ae56ea-1769-4179-be54-61eeaa54f2aa', '532a1663-47b2-4077-92fb-c68a2aa7ba48', '7241b8b6-2842-417a-bc56-08acefa7bd63'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:12 devstack sudo[104216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:12 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:12 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Deleted volume successfully.
Jun 16 18:47:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-745049c5-553e-42e9-92e3-a7702001f4f3 tempest-VolumesActionsTest-451689348 None] Lock "cinder-4cfcceed-afea-44f1-a888-682942e1148a-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-adf3770e-218e-4d10-9df2-ba9ed39c30d3-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Lock "cinder-adf3770e-218e-4d10-9df2-ba9ed39c30d3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-quobyte-adf3770e-218e-4d10-9df2-ba9ed39c30d3" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-adf3770e-218e-4d10-9df2-ba9ed39c30d3" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba9469-8757-49fb-a33e-faaa6dbfa05e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:13 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3
Jun 16 18:47:13 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[345a63ef-b020-4fa3-b9c1-ddf9ee1cdb52]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:14 devstack sudo[104230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18
Jun 16 18:47:14 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:14 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3" returned: 0 in 0.804s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:14 devstack sudo[104237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3
Jun 16 18:47:14 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:14 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '140afc82-0644-449a-8117-dc5395e0da15', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:47:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-9bfd9828-1c23-4214-8a12-a9a251cba5a2 req-e03144a0-5925-49e6-ad4f-56f393cf76ae tempest-AttachVolumeNegativeTest-843500524 None] attachment_update completed successfully.
Jun 16 18:47:15 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-adf3770e-218e-4d10-9df2-ba9ed39c30d3" returned: 0 in 0.660s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-adf3770e-218e-4d10-9df2-ba9ed39c30d3" released by "delete_volume" :: held 1.522s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Created reservations ['832e9f64-2bf7-470b-99c1-adf1444f7966', 'c58fe302-92f5-4f84-b78e-5cb6520db3e3', 'f6913f99-48bc-453f-b1b7-ab2eba9429b5', 'bc4b6339-3a0d-43e0-bddb-555bc8ef24f2'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:15 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:15 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:16 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.783s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Deleted volume successfully.
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8267e1f1-d4f0-4dca-8b0c-e06b1f8b854c tempest-TestStampPattern-267273018 None] Lock "cinder-adf3770e-218e-4d10-9df2-ba9ed39c30d3-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-f8dede33-4bf5-46ac-8016-80ddd1518655-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Lock "cinder-f8dede33-4bf5-46ac-8016-80ddd1518655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-quobyte-f952ea5a-6806-47be-90c4-d61151968ebe" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f952ea5a-6806-47be-90c4-d61151968ebe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-quobyte-f8dede33-4bf5-46ac-8016-80ddd1518655" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f8dede33-4bf5-46ac-8016-80ddd1518655" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Deleting offline snapshot f8dede33-4bf5-46ac-8016-80ddd1518655 of volume f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] snapshot_file for this snap is: volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f76ff87-c74b-45e4-a11d-f3f7a053b75f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:16 devstack sudo[104630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655
Jun 16 18:47:16 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:17 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655" returned: 0 in 0.761s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f952ea5a-6806-47be-90c4-d61151968ebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:47:17 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e21a8-ad8f-4ad4-9510-b8b6b69616ae]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:17 devstack sudo[104635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:47:17 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:18 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 0.754s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:18 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655
Jun 16 18:47:18 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Flow 'volume_create_manager' (bc93c721-8fa4-4fed-bd3e-8a61b668f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a6d5c4-ac7b-4325-bdec-18ba9fe1e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a6d5c4-ac7b-4325-bdec-18ba9fe1e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-542002300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c4ed02-60a9-4004-8a0d-b42ecaacaca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ae8912dd34c58bfae2d608ae67616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:18Z,use_quota=True,user_id='7dbd9f57fe1842b384dbee9160cb0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabc2322-ac84-444a-bc66-5178ae8000df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabc2322-ac84-444a-bc66-5178ae8000df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf90665-36ea-4bce-a7fb-8de42f2bc166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf90665-36ea-4bce-a7fb-8de42f2bc166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'volume_name': 'volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94ba977-80f1-4e32-838f-07b0d7daf335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94ba977-80f1-4e32-838f-07b0d7daf335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d535c842-cc8f-44bd-a1fc-f0bdfe46df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Volume 19c4ed02-60a9-4004-8a0d-b42ecaacaca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'volume_size': 1}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-542002300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c4ed02-60a9-4004-8a0d-b42ecaacaca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ae8912dd34c58bfae2d608ae67616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:18Z,use_quota=True,user_id='7dbd9f57fe1842b384dbee9160cb0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Creating volume 19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:18 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:18 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 1073741824
Jun 16 18:47:18 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:18 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655" returned: 0 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:18 devstack sudo[104648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655
Jun 16 18:47:18 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:19 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 1073741824" returned: 0 in 0.877s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:19 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe.f8dede33-4bf5-46ac-8016-80ddd1518655" returned: 0 in 0.670s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:19 devstack sudo[104656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:19 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f8dede33-4bf5-46ac-8016-80ddd1518655" released by "_delete_snapshot" :: held 3.062s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f952ea5a-6806-47be-90c4-d61151968ebe" released by "delete_snapshot" :: held 3.111s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Created reservations ['1d369c53-c1df-409b-b392-7f9d777205c4', 'cc2d655d-b167-43c0-8344-208d4c73450b', 'ee2cc6b2-e54d-40ca-9afc-c2cd09f206ac', '41325900-706d-4f02-877a-d6835d75c245'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Delete snapshot completed successfully.
Jun 16 18:47:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-57a08d5b-304d-4eab-9030-a588c3c437d2 tempest-TestStampPattern-267273018 None] Lock "cinder-f8dede33-4bf5-46ac-8016-80ddd1518655-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:20 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.600s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d535c842-cc8f-44bd-a1fc-f0bdfe46df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d760ec-8491-4185-87e2-961fe68a0337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:20 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Volume volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 (19c4ed02-60a9-4004-8a0d-b42ecaacaca5): created successfully
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d760ec-8491-4185-87e2-961fe68a0337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Flow 'volume_create_manager' (bc93c721-8fa4-4fed-bd3e-8a61b668f799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:20 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-45980684-ebfc-4d31-b090-c5aa99ef85e9 tempest-VolumesCloneTest-1071049816 None] Created volume successfully.
Jun 16 18:47:20 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-ae8dceb0-fe18-4656-ab86-46434349f5db req-6b5d8dcf-74af-47d5-b563-48ec85df0f6d tempest-AttachVolumeNegativeTest-843500524 None] Terminate volume connection completed successfully.
Jun 16 18:47:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-ae8dceb0-fe18-4656-ab86-46434349f5db req-6b5d8dcf-74af-47d5-b563-48ec85df0f6d tempest-AttachVolumeNegativeTest-843500524 None] Deleting attachment 140afc82-0644-449a-8117-dc5395e0da15. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Flow 'volume_create_manager' (8a721d7c-3159-481c-b570-54c4c6a81eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40804ab-2e06-44aa-a797-cd46d63a0f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40804ab-2e06-44aa-a797-cd46d63a0f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1741208940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c914be-50de-49b7-bdae-3678c4ed4977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ae8912dd34c58bfae2d608ae67616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=19c4ed02-60a9-4004-8a0d-b42ecaacaca5,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:21Z,use_quota=True,user_id='7dbd9f57fe1842b384dbee9160cb0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886034b-3759-48c7-ae4e-7b7768dfb3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886034b-3759-48c7-ae4e-7b7768dfb3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44b4477-0a2c-4a86-8d62-2a9c3863ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44b4477-0a2c-4a86-8d62-2a9c3863ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c1c914be-50de-49b7-bdae-3678c4ed4977', 'volume_name': 'volume-c1c914be-50de-49b7-bdae-3678c4ed4977', 'volume_size': 2, 'source_volid': '19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'source_volstatus': 'available'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0f90d-7509-4281-ab92-53dc9ed4e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0f90d-7509-4281-ab92-53dc9ed4e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895e2bf5-fd33-48c5-8e78-8f171195ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:21 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Volume c1c914be-50de-49b7-bdae-3678c4ed4977: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c1c914be-50de-49b7-bdae-3678c4ed4977', 'volume_size': 2, 'source_volid': '19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'source_volstatus': 'available'}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:21 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Cloning volume 19c4ed02-60a9-4004-8a0d-b42ecaacaca5 to volume c1c914be-50de-49b7-bdae-3678c4ed4977
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Creating offline snapshot b25ec42c-0778-4b5f-a935-65b2d122614e of volume 19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5897a-f187-4178-9215-b5587a6491e6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:21 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:21 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:21 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.770s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:22 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e 1G
Jun 16 18:47:22 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:22 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e 1G" returned: 0 in 0.771s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:22 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e
Jun 16 18:47:22 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:23 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e" returned: 0 in 1.019s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:23 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e is being set with open permissions: ugo+rw
Jun 16 18:47:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:23 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e
Jun 16 18:47:23 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:24 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e" returned: 0 in 0.912s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:24 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info
Jun 16 18:47:24 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:25 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info" returned: 0 in 0.791s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:25 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info is being set with open permissions: ugo+rw
Jun 16 18:47:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:25 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info
Jun 16 18:47:25 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:26 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.info" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "cinder-quobyte-c1c914be-50de-49b7-bdae-3678c4ed4977" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-c1c914be-50de-49b7-bdae-3678c4ed4977" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] snapshot: b25ec42c-0778-4b5f-a935-65b2d122614e, volume: c1c914be-50de-49b7-bdae-3678c4ed4977,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e4092-1026-4e75-aa0c-828b74c193b5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:26 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e
Jun 16 18:47:26 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:27 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e" returned: 0 in 0.798s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd190ca3-bbf4-40da-8995-80a19a70a631]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:27 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:27 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:27 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.736s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:47:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:27 devstack sudo[104888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977
Jun 16 18:47:27 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-f952ea5a-6806-47be-90c4-d61151968ebe-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Lock "cinder-f952ea5a-6806-47be-90c4-d61151968ebe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Acquiring lock "cinder-quobyte-f952ea5a-6806-47be-90c4-d61151968ebe" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f952ea5a-6806-47be-90c4-d61151968ebe" acquired by "delete_volume" :: waited 0.045s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:28 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c109ac-00c2-4a66-8ff7-fc5baad9c41f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:29 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:47:29 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:30 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 1.502s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:30 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe
Jun 16 18:47:30 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:31 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f952ea5a-6806-47be-90c4-d61151968ebe" returned: 0 in 1.211s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Lock "cinder-quobyte-f952ea5a-6806-47be-90c4-d61151968ebe" released by "delete_volume" :: held 2.893s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:31 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Created reservations ['d4db7808-727f-479f-a267-f4de18a85e3b', '2da110c7-e8a0-44ab-9e9c-d46e3c665fec', 'c7eaa108-f3ee-434f-8f72-1fa36d048fac', 'f35d5e6b-8556-4403-b8e1-52adb2fd0cbb'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:32 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:32 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "cinder-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "cinder-quobyte-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-quobyte-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" acquired by "delete_volume" :: waited 0.052s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68ef821-5e95-4ad0-9e43-0de361cb3167]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:32 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18
Jun 16 18:47:32 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:33 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.645s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Deleted volume successfully.
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-349cbfaf-444b-43be-96b0-8e261780c52f tempest-TestStampPattern-267273018 None] Lock "cinder-f952ea5a-6806-47be-90c4-d61151968ebe-delete_volume" released by "delete_volume" :: held 5.011s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:33 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977" returned: 0 in 5.995s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b51f3-0292-432c-9b55-11398dd6173d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:33 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:33 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:33 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" returned: 0 in 1.362s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:33 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18
Jun 16 18:47:33 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:34 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-quobyte-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18" released by "delete_volume" :: held 2.091s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Created reservations ['991ed51d-f78e-4a35-8ebb-d3a7c8941e96', '9d2ae4f8-1fd9-4093-9e03-c2f8a030beea', '31486293-3e3a-4dfe-b6fb-405a219b6dfe', '5c40551a-fbae-43b4-a348-c9c41b7b6157'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:34 devstack sudo[104929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:34 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:34 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.995s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:47:34 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Converted 1024.00 MB image at 170.80 MB/s
Jun 16 18:47:34 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 is being set with open permissions: ugo+rw
Jun 16 18:47:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:34 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977
Jun 16 18:47:34 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:35 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Deleted volume successfully.
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9acd89ca-542d-40e6-ad89-f6fbb70442ca tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-d3d9c85e-4a4b-4f4b-b5fd-34cb53780d18-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:35 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977" returned: 0 in 0.662s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-c1c914be-50de-49b7-bdae-3678c4ed4977" released by "_copy_volume_from_snapshot" :: held 9.323s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "cinder-quobyte-b25ec42c-0778-4b5f-a935-65b2d122614e" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-b25ec42c-0778-4b5f-a935-65b2d122614e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Deleting offline snapshot b25ec42c-0778-4b5f-a935-65b2d122614e of volume 19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] snapshot_file for this snap is: volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbdfbcb-830d-4750-9079-6f012f1ef03b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:35 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e
Jun 16 18:47:35 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "cinder-6b32d4e3-c8b3-495c-972d-b76799d0a642-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-6b32d4e3-c8b3-495c-972d-b76799d0a642-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "cinder-quobyte-6b32d4e3-c8b3-495c-972d-b76799d0a642" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-quobyte-6b32d4e3-c8b3-495c-972d-b76799d0a642" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b724a8-5781-4eac-bb91-212ec04dba8f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:36 devstack sudo[104938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642
Jun 16 18:47:36 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:36 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e" returned: 0 in 0.796s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc51344-7829-42b4-8e18-824a3f450174]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:36 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:36 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:36 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642" returned: 0 in 0.820s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:36 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642
Jun 16 18:47:36 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:37 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.833s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:37 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e
Jun 16 18:47:37 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:37 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6b32d4e3-c8b3-495c-972d-b76799d0a642" returned: 0 in 0.692s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-quobyte-6b32d4e3-c8b3-495c-972d-b76799d0a642" released by "delete_volume" :: held 1.568s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Created reservations ['5894b8b0-9012-4e45-93cf-1bf2fa1410f4', 'bb03d0ad-a91c-4896-aeec-a169d8da29de', 'dad8d449-38f8-44d2-a0c9-bd27c69c17e4', 'd08addf1-fa7b-4d82-abf1-96117cc4d1ec'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:37 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:37 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:37 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e" returned: 0 in 0.757s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:37 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e
Jun 16 18:47:37 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:38 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.656s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:38 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Deleted volume successfully.
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5f66b32-fdbc-4614-a9ca-4e2a8db32600 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-6b32d4e3-c8b3-495c-972d-b76799d0a642-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "cinder-669c700a-286f-4596-8445-dd5f073045b5-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-669c700a-286f-4596-8445-dd5f073045b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "cinder-quobyte-669c700a-286f-4596-8445-dd5f073045b5" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-quobyte-669c700a-286f-4596-8445-dd5f073045b5" acquired by "delete_volume" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ae0294-b0d1-40b0-96d5-7ccd29b7c52e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:38 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5.b25ec42c-0778-4b5f-a935-65b2d122614e" returned: 0 in 0.735s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-b25ec42c-0778-4b5f-a935-65b2d122614e" released by "_delete_snapshot" :: held 3.221s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:38 devstack sudo[104968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5
Jun 16 18:47:38 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.601s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895e2bf5-fd33-48c5-8e78-8f171195ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c914be-50de-49b7-bdae-3678c4ed4977', 'volume_size': 2, 'source_volid': '19c4ed02-60a9-4004-8a0d-b42ecaacaca5', 'source_volstatus': 'available'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eccbd6-4922-4ba9-afc7-5d665bb053fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:38 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Volume volume-c1c914be-50de-49b7-bdae-3678c4ed4977 (c1c914be-50de-49b7-bdae-3678c4ed4977): created successfully
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eccbd6-4922-4ba9-afc7-5d665bb053fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Flow 'volume_create_manager' (8a721d7c-3159-481c-b570-54c4c6a81eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:38 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-12c7b0d6-0c2b-4892-96ed-1ce73c363bb2 tempest-VolumesCloneTest-1071049816 None] Created volume successfully.
Jun 16 18:47:39 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5" returned: 0 in 0.738s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:39 devstack sudo[104974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5
Jun 16 18:47:39 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "cinder-c1c914be-50de-49b7-bdae-3678c4ed4977-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-c1c914be-50de-49b7-bdae-3678c4ed4977-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "cinder-quobyte-c1c914be-50de-49b7-bdae-3678c4ed4977" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-c1c914be-50de-49b7-bdae-3678c4ed4977" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03c00e-0020-412a-a96a-dfbb43196fbf]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:40 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-669c700a-286f-4596-8445-dd5f073045b5" returned: 0 in 0.660s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-quobyte-669c700a-286f-4596-8445-dd5f073045b5" released by "delete_volume" :: held 1.448s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Created reservations ['7833afbd-694d-4810-b8fa-ddfeccf628a9', '5ef3cf38-d773-4b86-a1da-fe253235b38f', '70aed7d8-e702-4c4f-9a5f-c94ea4546e7b', '111a27a3-7b98-4ec7-82bf-962d2de9ae47'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:40 devstack sudo[104978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977
Jun 16 18:47:40 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:40 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:40 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:40 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977" returned: 0 in 0.840s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:40 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977
Jun 16 18:47:40 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:40 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.748s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:40 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Deleted volume successfully.
Jun 16 18:47:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-05b00162-7e58-480c-b816-ddd9d70143b5 tempest-AttachVolumeNegativeTest-843500524 None] Lock "cinder-669c700a-286f-4596-8445-dd5f073045b5-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:41 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c1c914be-50de-49b7-bdae-3678c4ed4977" returned: 0 in 0.708s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-c1c914be-50de-49b7-bdae-3678c4ed4977" released by "delete_volume" :: held 1.599s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Created reservations ['e0a55bb4-02d8-424d-b5ef-2e00d490b03e', 'f8347cc1-e5bb-48ef-b192-68c5357b6b6f', '4b601d4b-7e8f-4ae7-9846-b647e969e572', 'dd8a21aa-ed17-474e-8c65-291a14069427'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:41 devstack sudo[104990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:41 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:42 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:42 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "cinder-19c4ed02-60a9-4004-8a0d-b42ecaacaca5-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-19c4ed02-60a9-4004-8a0d-b42ecaacaca5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "cinder-quobyte-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e0161f-2a28-4e93-aeb3-e5106cee38ea]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:42 devstack sudo[104994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:42 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:42 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.893s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Deleted volume successfully.
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-84b212fe-a37e-4015-91c2-a9689873d124 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-c1c914be-50de-49b7-bdae-3678c4ed4977-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:42 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.830s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:47:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:47:43 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.871s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:43 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5
Jun 16 18:47:43 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:43 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" returned: 0 in 0.663s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-quobyte-19c4ed02-60a9-4004-8a0d-b42ecaacaca5" released by "delete_volume" :: held 1.611s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Created reservations ['b1f2d7b0-3522-4f0e-941a-ede5d68c3589', 'f3aa4660-ece6-4862-9e71-5f913a7c1f3c', 'e73d8ef4-bcd0-4017-a60f-909dbab852d6', 'b430b79c-edc2-4674-9671-8141f9c2f283'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:44 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:44 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:44 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.819s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Deleted volume successfully.
Jun 16 18:47:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a953ffc9-c522-4e1c-890b-267a15e6e800 tempest-VolumesCloneTest-1071049816 None] Lock "cinder-19c4ed02-60a9-4004-8a0d-b42ecaacaca5-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (04446aff-a186-41d1-8955-d132a394c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfab74d-9c8d-4fe7-8c5e-98132dbba8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfab74d-9c8d-4fe7-8c5e-98132dbba8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1500139621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5738ad-9c79-4982-9201-b3d3803a57fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:48Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebae892-01d5-41d8-9d3a-6b206d6dab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebae892-01d5-41d8-9d3a-6b206d6dab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c4c44c-2f48-460b-897b-d2376ce7b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c4c44c-2f48-460b-897b-d2376ce7b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5738ad-9c79-4982-9201-b3d3803a57fd', 'volume_name': 'volume-7c5738ad-9c79-4982-9201-b3d3803a57fd', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c73167-a64b-4f7d-ba75-fd324bfc6ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c73167-a64b-4f7d-ba75-fd324bfc6ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dbc3de-f2fb-4f3a-8801-9af289a3256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Volume 7c5738ad-9c79-4982-9201-b3d3803a57fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5738ad-9c79-4982-9201-b3d3803a57fd', 'volume_size': 1}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1500139621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5738ad-9c79-4982-9201-b3d3803a57fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:48Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Creating volume 7c5738ad-9c79-4982-9201-b3d3803a57fd {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:48 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:48 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd 1073741824
Jun 16 18:47:48 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Flow 'volume_create_manager' (8e17b607-86a1-4fbb-9472-6bb063d7b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17847cd7-6818-4e67-8e03-71810d6eec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17847cd7-6818-4e67-8e03-71810d6eec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d345ea-0d09-4986-9416-13b979cb3036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fe138b80a4146be6c725b5ce7245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:49Z,use_quota=True,user_id='0c4d8eb8882a42d79d08fb9c3afa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ece413-45dd-4705-95aa-29e35fde57bb),volume_type_id=f9ece413-45dd-4705-95aa-29e35fde57bb)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6633ca3-f533-424c-8a71-227469266549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6633ca3-f533-424c-8a71-227469266549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a282d813-cca5-4db2-964f-ad98156e0a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:47:49 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd 1073741824" returned: 0 in 0.863s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:49 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd
Jun 16 18:47:49 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a282d813-cca5-4db2-964f-ad98156e0a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4d345ea-0d09-4986-9416-13b979cb3036', 'volume_name': 'volume-a4d345ea-0d09-4986-9416-13b979cb3036', 'volume_size': 1, 'image_id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9647a21-f184-4200-86ac-e683c3acbaac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b6f4935d3d0349dbf9dee29ba367de4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '329fe138b80a4146be6c725b5ce7245a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eec8565249dcc3e3a65342561618aaa50488871769ef48acc38e63ebc0f887fedae4f266fcc8b2d3b53a8ec0c896549260c810245ba8b199cfbb24d8bf259ac', 'id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'created_at': datetime.datetime(2026, 6, 16, 16, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 47, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9647a21-f184-4200-86ac-e683c3acbaac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545bd67a40>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f27f6c9-0276-4aa0-b8b6-324fce910066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f27f6c9-0276-4aa0-b8b6-324fce910066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522660e4-b1d2-43a9-b356-eb3fdda8aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:49 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Volume a4d345ea-0d09-4986-9416-13b979cb3036: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4d345ea-0d09-4986-9416-13b979cb3036', 'volume_size': 1, 'image_id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9647a21-f184-4200-86ac-e683c3acbaac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b6f4935d3d0349dbf9dee29ba367de4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '329fe138b80a4146be6c725b5ce7245a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eec8565249dcc3e3a65342561618aaa50488871769ef48acc38e63ebc0f887fedae4f266fcc8b2d3b53a8ec0c896549260c810245ba8b199cfbb24d8bf259ac', 'id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'created_at': datetime.datetime(2026, 6, 16, 16, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 47, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9647a21-f184-4200-86ac-e683c3acbaac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545bd67a40>}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Trying to clone a4d345ea-0d09-4986-9416-13b979cb3036 from image c9647a21-f184-4200-86ac-e683c3acbaac at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9647a21-f184-4200-86ac-e683c3acbaac', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:47:49 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Image download 0.00 MB at 0.00 MB/s
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5f330784-970b-425b-a836-6302c1521d1c tempest-BackendsCapabilitiesAdminTestsJSON-1578971331 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.722557067871, 'free_capacity_gb': 1775.722557067871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91851) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df5b25d-4d63-4db6-a5f8-2bcd7a19e209]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:49 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD
Jun 16 18:47:49 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:49 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd" returned: 0 in 0.611s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dbc3de-f2fb-4f3a-8801-9af289a3256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5738ad-9c79-4982-9201-b3d3803a57fd', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1521fa79-fd65-4485-967c-60413e0022a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:49 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Volume volume-7c5738ad-9c79-4982-9201-b3d3803a57fd (7c5738ad-9c79-4982-9201-b3d3803a57fd): created successfully
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1521fa79-fd65-4485-967c-60413e0022a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (04446aff-a186-41d1-8955-d132a394c283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:49 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-afb693a6-f566-45ea-b85f-3d49737f024c tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:47:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d309c7c5-014c-45c9-bde7-3afac3726fd4 tempest-BackendsCapabilitiesAdminTestsJSON-1578971331 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.722557067871, 'free_capacity_gb': 1775.722557067871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91851) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}}
Jun 16 18:47:50 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:50 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD
Jun 16 18:47:50 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:50 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (b910cbff-a0fd-4b3f-a82b-0ad98787d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8573da0-3d36-484d-9508-909c69ec7149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8573da0-3d36-484d-9508-909c69ec7149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1446480047',display_name='tempest-VolumesGetTest-Volume-2050667840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be62886-25a8-4857-8882-a76bc9550c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:51Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a93b2a-007c-4453-b237-25e497059944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a93b2a-007c-4453-b237-25e497059944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b715d9cf-d3fc-446d-982f-51532975e734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b715d9cf-d3fc-446d-982f-51532975e734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be62886-25a8-4857-8882-a76bc9550c46', 'volume_name': 'volume-2be62886-25a8-4857-8882-a76bc9550c46', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e82385f-3e96-479d-a6c4-6df256c31075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e82385f-3e96-479d-a6c4-6df256c31075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a5c739-e275-48cf-a6d0-45ae3b7b1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:51 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Volume 2be62886-25a8-4857-8882-a76bc9550c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be62886-25a8-4857-8882-a76bc9550c46', 'volume_size': 1}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1446480047',display_name='tempest-VolumesGetTest-Volume-2050667840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be62886-25a8-4857-8882-a76bc9550c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:51Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Creating volume 2be62886-25a8-4857-8882-a76bc9550c46 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:51 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:51 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD" returned: 1 in 0.778s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Temporary image c9647a21-f184-4200-86ac-e683c3acbaac is fetched for user 0c4d8eb8882a42d79d08fb9c3afa7915. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:47:51 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46 1073741824
Jun 16 18:47:51 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[19236665-f578-4fb8-9e2d-30efe6834827]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:51 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD
Jun 16 18:47:51 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:51 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:52 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46 1073741824" returned: 0 in 0.920s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:52 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46
Jun 16 18:47:52 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:52 devstack sudo[105039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD
Jun 16 18:47:52 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:52 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:52 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46" returned: 0 in 0.694s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d345ea-0d09-4986-9416-13b979cb3036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fe138b80a4146be6c725b5ce7245a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:49Z,use_quota=True,user_id='0c4d8eb8882a42d79d08fb9c3afa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ece413-45dd-4705-95aa-29e35fde57bb),volume_type_id=f9ece413-45dd-4705-95aa-29e35fde57bb)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Creating volume a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:52 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:52 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 1073741824
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a5c739-e275-48cf-a6d0-45ae3b7b1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be62886-25a8-4857-8882-a76bc9550c46', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:52 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f6ff85-1487-437b-8684-248c6bff01c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:52 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Volume volume-2be62886-25a8-4857-8882-a76bc9550c46 (2be62886-25a8-4857-8882-a76bc9550c46): created successfully
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f6ff85-1487-437b-8684-248c6bff01c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (b910cbff-a0fd-4b3f-a82b-0ad98787d347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:52 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-10d400af-40c3-41cb-a091-f025ac9a040e tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-2be62886-25a8-4857-8882-a76bc9550c46-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Lock "cinder-2be62886-25a8-4857-8882-a76bc9550c46-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=88,cinder:SELECT=81,cinder:INSERT=22,cinder:DELETE=4 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=70,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=9 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-2be62886-25a8-4857-8882-a76bc9550c46" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-2be62886-25a8-4857-8882-a76bc9550c46" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[555a8df7-9a95-43d8-85b6-3ac0055acae1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:53 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46
Jun 16 18:47:53 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:53 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 1073741824" returned: 0 in 0.912s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:53 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:47:53 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:54 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:54 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46
Jun 16 18:47:54 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:54 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 0 in 0.612s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Attempting download of c9647a21-f184-4200-86ac-e683c3acbaac ((None, [{'url': 'file:///opt/stack/data/glance/images/c9647a21-f184-4200-86ac-e683c3acbaac', 'metadata': {}}])) to volume a4d345ea-0d09-4986-9416-13b979cb3036. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bde095-abd7-47f5-a33f-79f6154a8813]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:54 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd
Jun 16 18:47:54 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:54 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2be62886-25a8-4857-8882-a76bc9550c46" returned: 0 in 0.626s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-2be62886-25a8-4857-8882-a76bc9550c46" released by "delete_volume" :: held 1.426s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Created reservations ['cb6d3f17-4e43-4987-98eb-0707d3a4eab3', 'c57ff786-bb50-43f2-8b8b-8192911a7a04', '21d7e95a-f82f-478b-a1e6-ba64f2442d1c', 'c23a3813-3f7c-412f-888e-19c121c70f5d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:54 devstack sudo[105065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:54 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:55 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd" returned: 0 in 0.727s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:55 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd
Jun 16 18:47:55 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:55 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.633s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-28501b18-3649-4b07-8879-ddf8e07bff80 tempest-VolumesGetTest-698891446 None] Lock "cinder-2be62886-25a8-4857-8882-a76bc9550c46-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-7c5738ad-9c79-4982-9201-b3d3803a57fd-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Lock "cinder-7c5738ad-9c79-4982-9201-b3d3803a57fd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-7c5738ad-9c79-4982-9201-b3d3803a57fd" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:47:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-397d83c0-c5ab-4209-873d-7fd0f729c7fc tempest-GroupSnapshotsTest-453261221 None] Group tempest-GroupSnapshotsTest-Group-1235303677: creating
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-7c5738ad-9c79-4982-9201-b3d3803a57fd" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:47:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-397d83c0-c5ab-4209-873d-7fd0f729c7fc tempest-GroupSnapshotsTest-453261221 None] Group tempest-GroupSnapshotsTest-Group-1235303677: created successfully
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e91f0-66b3-4776-8c4c-2c84d46bcae2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-397d83c0-c5ab-4209-873d-7fd0f729c7fc tempest-GroupSnapshotsTest-453261221 None] Create group completed successfully.
Jun 16 18:47:55 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd" returned: 1 in 0.743s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9647a21-f184-4200-86ac-e683c3acbaac_6l6bq7gd' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447ae7a-3d96-4b95-937e-5185ab2ede44]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:55 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd
Jun 16 18:47:55 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:55 devstack sudo[105075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD
Jun 16 18:47:55 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:56 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd" returned: 0 in 0.720s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:56 devstack sudo[105083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd
Jun 16 18:47:56 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:56 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:56 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD
Jun 16 18:47:56 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:57 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7c5738ad-9c79-4982-9201-b3d3803a57fd" returned: 0 in 0.575s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-7c5738ad-9c79-4982-9201-b3d3803a57fd" released by "delete_volume" :: held 1.348s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Created reservations ['3408f5c1-5ff9-43fc-b459-385c58d352e1', 'b152e976-eb40-4ed1-b919-5c7f11f2d389', '45ec4cfe-23dd-4717-8b93-e141f573d5dc', '5a613206-4781-4a60-af5d-42a255622ef7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:57 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] c9647a21-f184-4200-86ac-e683c3acbaac was raw, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:47:57 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:47:57 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:57 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:47:57 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (19e2c433-2ec1-425c-bbae-10fa171420cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a995f362-49ad-4767-bd98-3f89a1c130b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a995f362-49ad-4767-bd98-3f89a1c130b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901109974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=312f83e2-320b-462f-8748-c0e6f1d1894e,host='devstack@QuobyteHD#QuobyteHD',id=1eb02ee3-5a2b-4bc5-a404-707a0acb042d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:57Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3823a21a-b64f-4bfd-94a9-128b72a5f544),volume_type_id=3823a21a-b64f-4bfd-94a9-128b72a5f544)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae40a98-b0e8-46a9-ad44-86846375ee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae40a98-b0e8-46a9-ad44-86846375ee33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d36fc86-83f4-4683-9300-49a903fd0daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d36fc86-83f4-4683-9300-49a903fd0daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb02ee3-5a2b-4bc5-a404-707a0acb042d', 'volume_name': 'volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bb6304-125a-466b-b392-540be6da3668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bb6304-125a-466b-b392-540be6da3668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c33132c-e149-4f1d-8d55-179d95214473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:57 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Volume 1eb02ee3-5a2b-4bc5-a404-707a0acb042d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d', 'volume_size': 1}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=312f83e2-320b-462f-8748-c0e6f1d1894e,created_at=2026-06-16T16:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901109974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=312f83e2-320b-462f-8748-c0e6f1d1894e,host='devstack@QuobyteHD#QuobyteHD',id=1eb02ee3-5a2b-4bc5-a404-707a0acb042d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:57Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3823a21a-b64f-4bfd-94a9-128b72a5f544),volume_type_id=3823a21a-b64f-4bfd-94a9-128b72a5f544)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Creating volume 1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:57 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:57 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d 1073741824
Jun 16 18:47:57 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:57 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.657s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:47:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:47:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ec995a94-b01e-452d-96e7-ae7ec00ef010 tempest-VolumesGetTest-698891446 None] Lock "cinder-7c5738ad-9c79-4982-9201-b3d3803a57fd-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:47:58 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 0 in 0.747s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9647a21-f184-4200-86ac-e683c3acbaac_movnx2rndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:47:58 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Converted 0.00 MB image at 0.00 MB/s
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:58 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 1G
Jun 16 18:47:58 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:47:58 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (23543677-fdcd-48bf-a835-e0ccb46caba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda11b36-cb07-4e8b-969a-fec890cbbd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d 1073741824" returned: 0 in 0.928s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda11b36-cb07-4e8b-969a-fec890cbbd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-350843034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7e330b-30b4-4671-8a21-9f6b8b76ecea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:58Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69cc300-ff6b-4920-8a9c-220378435bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69cc300-ff6b-4920-8a9c-220378435bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745363a0-5f56-43a7-a0b6-3c276c82e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745363a0-5f56-43a7-a0b6-3c276c82e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'volume_name': 'volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a63397-6c71-490a-b457-d150dabcae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a63397-6c71-490a-b457-d150dabcae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c538917-a3cd-45e0-9629-d7ad645323dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Volume 5c7e330b-30b4-4671-8a21-9f6b8b76ecea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'volume_size': 1}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:58 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:47:58 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:58 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 1G" returned: 0 in 0.639s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d029d7-f57a-4498-adc5-f89f8241888a]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:47:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:58 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:47:58 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:59 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.620s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-350843034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7e330b-30b4-4671-8a21-9f6b8b76ecea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:47:58Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Creating volume 5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:47:59 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:59 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea 1073741824
Jun 16 18:47:59 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c33132c-e149-4f1d-8d55-179d95214473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e162e795-11f4-45bd-9769-6166af093492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:47:59 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Volume volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d (1eb02ee3-5a2b-4bc5-a404-707a0acb042d): created successfully
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e162e795-11f4-45bd-9769-6166af093492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (19e2c433-2ec1-425c-bbae-10fa171420cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:47:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-903e156f-be7d-4c52-93c7-1b64909cbcd6 tempest-GroupSnapshotsTest-453261221 None] Created volume successfully.
Jun 16 18:47:59 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 0 in 0.724s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:59 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:47:59 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:47:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] GroupSnapshot f884b071-1ea0-4adf-afdd-c7823720ccef: creating.
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Group snapshot f884b071-1ea0-4adf-afdd-c7823720ccef: creating. {{(pid=91851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:47:59 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea 1073741824" returned: 0 in 0.831s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:47:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:47:59 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:47:59 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:00 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 1 in 0.735s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Downloaded image c9647a21-f184-4200-86ac-e683c3acbaac ((None, [{'url': 'file:///opt/stack/data/glance/images/c9647a21-f184-4200-86ac-e683c3acbaac', 'metadata': {}}])) to volume a4d345ea-0d09-4986-9416-13b979cb3036 successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Temporary image c9647a21-f184-4200-86ac-e683c3acbaac for user 0c4d8eb8882a42d79d08fb9c3afa7915 is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Marking volume a4d345ea-0d09-4986-9416-13b979cb3036 as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Copying metadata from image c9647a21-f184-4200-86ac-e683c3acbaac to a4d345ea-0d09-4986-9416-13b979cb3036. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Creating volume glance metadata for volume a4d345ea-0d09-4986-9416-13b979cb3036 backed by image c9647a21-f184-4200-86ac-e683c3acbaac with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5b6f4935d3d0349dbf9dee29ba367de4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522660e4-b1d2-43a9-b356-eb3fdda8aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d345ea-0d09-4986-9416-13b979cb3036', 'volume_size': 1, 'image_id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9647a21-f184-4200-86ac-e683c3acbaac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b6f4935d3d0349dbf9dee29ba367de4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '329fe138b80a4146be6c725b5ce7245a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eec8565249dcc3e3a65342561618aaa50488871769ef48acc38e63ebc0f887fedae4f266fcc8b2d3b53a8ec0c896549260c810245ba8b199cfbb24d8bf259ac', 'id': 'c9647a21-f184-4200-86ac-e683c3acbaac', 'created_at': datetime.datetime(2026, 6, 16, 16, 47, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 47, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9647a21-f184-4200-86ac-e683c3acbaac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545bd67a40>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a14bce-29e1-4e27-88c0-940a91509a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Volume volume-a4d345ea-0d09-4986-9416-13b979cb3036 (a4d345ea-0d09-4986-9416-13b979cb3036): created successfully
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a14bce-29e1-4e27-88c0-940a91509a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Flow 'volume_create_manager' (8e17b607-86a1-4fbb-9472-6bb063d7b180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7aeb511d-c25b-403d-a0df-59427a9079da tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Created volume successfully.
Jun 16 18:48:00 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.631s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.826s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c538917-a3cd-45e0-9629-d7ad645323dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec384ecb-4ad0-4def-93ef-f598c7c25988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Creating offline snapshot dfdb23c5-460f-488d-bfcb-61f0254c0efe of volume 1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:48:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Volume volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea (5c7e330b-30b4-4671-8a21-9f6b8b76ecea): created successfully
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec384ecb-4ad0-4def-93ef-f598c7c25988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (23543677-fdcd-48bf-a835-e0ccb46caba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f0cd5-5602-4afb-a976-0f3d98a10492]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e9270a18-4f5e-4c7a-a047-f4d5b3ecea60 tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:48:00 devstack sudo[105131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:48:00 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Acquiring lock "cinder-a4d345ea-0d09-4986-9416-13b979cb3036-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "cinder-a4d345ea-0d09-4986-9416-13b979cb3036-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Acquiring lock "cinder-quobyte-a4d345ea-0d09-4986-9416-13b979cb3036" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "cinder-quobyte-a4d345ea-0d09-4986-9416-13b979cb3036" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8926fb09-b7b4-49d9-b3e9-16c2a9e03ea6]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:01 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:48:01 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:01 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.706s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:01 devstack sudo[105138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe 1G
Jun 16 18:48:01 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:01 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 0 in 0.736s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:01 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:01 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:48:01 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (e4a6ff5a-d85c-4cb9-a3c5-5197aaafcac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a627fb-c171-41f7-8fb5-91416b270360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a627fb-c171-41f7-8fb5-91416b270360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2075274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4528824d-65ad-4132-9c00-202bc1dbd0af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5c7e330b-30b4-4671-8a21-9f6b8b76ecea,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:02Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b265c69-ed0b-4fb0-8fc4-d542b0379510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b265c69-ed0b-4fb0-8fc4-d542b0379510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed5242e-8a93-4453-a05c-5122dab508d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed5242e-8a93-4453-a05c-5122dab508d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4528824d-65ad-4132-9c00-202bc1dbd0af', 'volume_name': 'volume-4528824d-65ad-4132-9c00-202bc1dbd0af', 'volume_size': 1, 'source_volid': '5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'source_volstatus': 'available'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977e9139-1663-4035-9113-ac974657c0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977e9139-1663-4035-9113-ac974657c0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1527938f-d1e9-4d4e-97ba-d8c92ffcf54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:02 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Volume 4528824d-65ad-4132-9c00-202bc1dbd0af: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4528824d-65ad-4132-9c00-202bc1dbd0af', 'volume_size': 1, 'source_volid': '5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'source_volstatus': 'available'}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:02 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe 1G" returned: 0 in 0.858s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:02 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe
Jun 16 18:48:02 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:02 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 1 in 0.737s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:02 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036
Jun 16 18:48:02 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:02 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe" returned: 0 in 0.648s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:02 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:02 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe
Jun 16 18:48:02 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:03 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a4d345ea-0d09-4986-9416-13b979cb3036" returned: 0 in 0.579s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "cinder-quobyte-a4d345ea-0d09-4986-9416-13b979cb3036" released by "delete_volume" :: held 2.122s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:03 devstack cinder-volume[91851]: WARNING cinder.quota [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:48:03 devstack cinder-volume[91851]: WARNING cinder.quota [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Created reservations ['28223c28-3396-4b57-97db-3f4a0d546a0f', 'b97fda48-bf26-4b70-bd08-8c96e8a008c5', '716da1e1-b067-4811-b7ca-32c288e9d250', '20c4996f-6c2c-4880-8bda-21a9f00a4f06'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:03 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:03 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:03 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:03 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info
Jun 16 18:48:03 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:03 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Deleted volume successfully.
Jun 16 18:48:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-114e0a31-1ad8-49d5-9e87-0b9ca9b10ce6 tempest-VolumeAndVolumeTypeFromImageTest-1516279183 None] Lock "cinder-a4d345ea-0d09-4986-9416-13b979cb3036-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:04 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:04 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:04 devstack sudo[105169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info
Jun 16 18:48:04 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:04 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.info" returned: 0 in 0.574s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.057s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.523s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:04 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Cloning volume 5c7e330b-30b4-4671-8a21-9f6b8b76ecea to volume 4528824d-65ad-4132-9c00-202bc1dbd0af
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Creating offline snapshot 6f70edc6-987a-4a53-a13c-f76ff9f26e6d of volume 5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff4d4a-f78e-4aca-964c-fb0bdbe74f6e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1c9d6aee-66de-43b4-b217-e7587829b281 tempest-GroupSnapshotsTest-453261221 None] group_snapshot f884b071-1ea0-4adf-afdd-c7823720ccef: created successfully
Jun 16 18:48:04 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:48:04 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:05 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.784s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:05 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d 1G
Jun 16 18:48:05 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:06 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d 1G" returned: 0 in 0.867s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:06 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d
Jun 16 18:48:06 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:06 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d" returned: 0 in 0.647s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:07 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d is being set with open permissions: ugo+rw
Jun 16 18:48:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:07 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d
Jun 16 18:48:07 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:07 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d" returned: 0 in 0.596s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:07 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info
Jun 16 18:48:07 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:08 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info" returned: 0 in 0.600s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:08 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info is being set with open permissions: ugo+rw
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:08 devstack sudo[105194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info
Jun 16 18:48:08 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (11d4e163-e6c6-4052-885a-97635c3f1945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddffc4f-83ac-452b-86d9-85838b1527f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddffc4f-83ac-452b-86d9-85838b1527f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894589031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb60c592-f0d6-492d-befd-23a2f3564f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:09Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988a65d1-fd6a-4b09-9f29-63461230cb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988a65d1-fd6a-4b09-9f29-63461230cb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8493eb8a-0bf8-4dd7-a156-053e6c0d504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8493eb8a-0bf8-4dd7-a156-053e6c0d504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb60c592-f0d6-492d-befd-23a2f3564f95', 'volume_name': 'volume-fb60c592-f0d6-492d-befd-23a2f3564f95', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb932ff-c489-4004-a96d-2d383807cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb932ff-c489-4004-a96d-2d383807cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4f7a34-997f-4fcb-a9c0-223f2c2c228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Volume fb60c592-f0d6-492d-befd-23a2f3564f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb60c592-f0d6-492d-befd-23a2f3564f95', 'volume_size': 1}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:08 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.info" returned: 0 in 0.613s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-4528824d-65ad-4132-9c00-202bc1dbd0af" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-4528824d-65ad-4132-9c00-202bc1dbd0af" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] snapshot: 6f70edc6-987a-4a53-a13c-f76ff9f26e6d, volume: 4528824d-65ad-4132-9c00-202bc1dbd0af,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b355e-d971-41e5-8f83-3266839357b2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (99759163-66fe-493d-9b32-c27081b1fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1829442-ce35-4785-99c3-faa16e81819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d
Jun 16 18:48:09 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1829442-ce35-4785-99c3-faa16e81819f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645429867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f531ed-e03a-4790-b263-e1c50b0b7deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:09Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e71bcb-eb0a-4ec4-94d7-2fc41fb5ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e71bcb-eb0a-4ec4-94d7-2fc41fb5ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c620080f-2c3f-4a93-97f7-79806181336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c620080f-2c3f-4a93-97f7-79806181336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f531ed-e03a-4790-b263-e1c50b0b7deb', 'volume_name': 'volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7001083a-5a28-45e0-9ee0-24282dbcb0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7001083a-5a28-45e0-9ee0-24282dbcb0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ee3bff-7e4e-4234-b98f-9b00e2d5e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Volume b5f531ed-e03a-4790-b263-e1c50b0b7deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb', 'volume_size': 1}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (33d61ca8-6048-4139-bf90-b5dc7091e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c9f5d7-1e5d-4d01-821a-964a27750546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c9f5d7-1e5d-4d01-821a-964a27750546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1071131465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed496044-d2fd-4166-ab53-ef60c6b74293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:09Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00404943-cc0b-4154-bbd1-cbcb08cf8b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00404943-cc0b-4154-bbd1-cbcb08cf8b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d455b60e-f185-4d5a-b96e-b55540481f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d455b60e-f185-4d5a-b96e-b55540481f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed496044-d2fd-4166-ab53-ef60c6b74293', 'volume_name': 'volume-ed496044-d2fd-4166-ab53-ef60c6b74293', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36dd5ab0-a03e-45ef-af73-8d6bb952f89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36dd5ab0-a03e-45ef-af73-8d6bb952f89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c493a874-c2e7-43ed-98a0-d185c7218ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Volume ed496044-d2fd-4166-ab53-ef60c6b74293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed496044-d2fd-4166-ab53-ef60c6b74293', 'volume_size': 1}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:09 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (0c4296e8-5592-4a49-b8ab-9cbe66049091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe126b2c-728e-4144-94a8-579a6e327e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d" returned: 0 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe126b2c-728e-4144-94a8-579a6e327e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839863227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741bcf07-8189-4810-a550-24e4664728a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:10Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fc5e5d-e194-4dbf-8496-b96d5cbbe3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fc5e5d-e194-4dbf-8496-b96d5cbbe3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4233a716-3993-4db2-b768-c3b8cda148a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4233a716-3993-4db2-b768-c3b8cda148a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741bcf07-8189-4810-a550-24e4664728a7', 'volume_name': 'volume-741bcf07-8189-4810-a550-24e4664728a7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991b4743-4aad-401d-8a0a-46efe6dc2152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991b4743-4aad-401d-8a0a-46efe6dc2152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6626fb5-e6b7-42ee-ab4c-300924999f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:09 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Volume 741bcf07-8189-4810-a550-24e4664728a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741bcf07-8189-4810-a550-24e4664728a7', 'volume_size': 1}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b66a1-bea6-41d0-892b-62c640e357cb]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:09 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:48:09 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (58732fba-02f3-4916-bc80-24dc1820127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f4b1a-7164-40fe-a07a-33e3ee49e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f4b1a-7164-40fe-a07a-33e3ee49e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1978539956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:10Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a522f4b2-5690-41a4-a207-98985eccb9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a522f4b2-5690-41a4-a207-98985eccb9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32d058d-6885-4e0c-a376-1e43c6a6ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32d058d-6885-4e0c-a376-1e43c6a6ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b', 'volume_name': 'volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700cfd9e-e954-4a9f-8995-f08490e52d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700cfd9e-e954-4a9f-8995-f08490e52d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac8200c-7ca9-4f5c-84cd-7116d494eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Volume 2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b', 'volume_size': 1}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:10 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.721s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:48:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:10 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af
Jun 16 18:48:10 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:15 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af" returned: 0 in 4.534s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[50716920-8a9c-47de-a845-eee56d07afe0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:15 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:48:15 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:15 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.865s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:15 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:48:15 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Converted 1024.00 MB image at 225.79 MB/s
Jun 16 18:48:15 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af is being set with open permissions: ugo+rw
Jun 16 18:48:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:15 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af
Jun 16 18:48:15 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:16 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af" returned: 0 in 0.592s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-4528824d-65ad-4132-9c00-202bc1dbd0af" released by "_copy_volume_from_snapshot" :: held 7.652s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-6f70edc6-987a-4a53-a13c-f76ff9f26e6d" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-6f70edc6-987a-4a53-a13c-f76ff9f26e6d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Deleting offline snapshot 6f70edc6-987a-4a53-a13c-f76ff9f26e6d of volume 5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] snapshot_file for this snap is: volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c471feda-d27a-43a9-92c2-ee775cf0e862]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:16 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d
Jun 16 18:48:16 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:17 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d" returned: 0 in 0.692s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:48:17 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a935d94e-49fe-494e-957d-58ec0dc470c9]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:17 devstack sudo[105234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:48:17 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:17 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.689s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:18 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d
Jun 16 18:48:18 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:18 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d" returned: 0 in 0.697s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:18 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d
Jun 16 18:48:18 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:19 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea.6f70edc6-987a-4a53-a13c-f76ff9f26e6d" returned: 0 in 0.580s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-6f70edc6-987a-4a53-a13c-f76ff9f26e6d" released by "_delete_snapshot" :: held 2.734s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.698s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.195s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-dfdb23c5-460f-488d-bfcb-61f0254c0efe-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1527938f-d1e9-4d4e-97ba-d8c92ffcf54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4528824d-65ad-4132-9c00-202bc1dbd0af', 'volume_size': 1, 'source_volid': '5c7e330b-30b4-4671-8a21-9f6b8b76ecea', 'source_volstatus': 'available'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19df18be-d1a5-4ba4-8d1e-7dc564d9e2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-dfdb23c5-460f-488d-bfcb-61f0254c0efe-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Creating volume b173f94c-6148-43f9-a7ed-3a9aa5e4b742 from snapshot dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Volume volume-4528824d-65ad-4132-9c00-202bc1dbd0af (4528824d-65ad-4132-9c00-202bc1dbd0af): created successfully
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19df18be-d1a5-4ba4-8d1e-7dc564d9e2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (e4a6ff5a-d85c-4cb9-a3c5-5197aaafcac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] snapshot: dfdb23c5-460f-488d-bfcb-61f0254c0efe, volume: b173f94c-6148-43f9-a7ed-3a9aa5e4b742,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-c151f61c-982c-42a4-b2e4-7acb0f367004 tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2802f9f8-1940-4c27-adeb-31305587d465]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:19 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe
Jun 16 18:48:19 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:20 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe" returned: 0 in 0.684s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ebfba-3b7f-4e4c-835e-f3bb26136f1f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:20 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:48:20 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:20 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.717s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:20 devstack sudo[105264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742
Jun 16 18:48:20 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (5edfe0d7-d4d0-4d78-8d30-850b6965d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d09a42b-ebe4-4d02-9073-5ecd8073175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d09a42b-ebe4-4d02-9073-5ecd8073175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1976563015',display_name='tempest-VolumesGetTest-Volume-2138892746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9997ddc7-152f-4bb4-afd4-6827a0404359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:21Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c2d8d1-822f-4604-bfb5-2f2f7649c8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c2d8d1-822f-4604-bfb5-2f2f7649c8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900dcaf0-c9c7-450e-9947-f57f204c189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900dcaf0-c9c7-450e-9947-f57f204c189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9997ddc7-152f-4bb4-afd4-6827a0404359', 'volume_name': 'volume-9997ddc7-152f-4bb4-afd4-6827a0404359', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b60d1d-760e-4aa3-9bb4-1e056052fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b60d1d-760e-4aa3-9bb4-1e056052fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7e8933-7ec3-4480-9213-70b737cbdabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:21 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Volume 9997ddc7-152f-4bb4-afd4-6827a0404359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9997ddc7-152f-4bb4-afd4-6827a0404359', 'volume_size': 1}
Jun 16 18:48:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:25 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" returned: 0 in 4.480s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f18a33-8911-4a1c-adec-0701b941ce29]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:25 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:48:25 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:26 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.876s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:48:26 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Converted 1024.00 MB image at 228.54 MB/s
Jun 16 18:48:26 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:26 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742
Jun 16 18:48:26 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:26 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" returned: 0 in 0.588s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" released by "_copy_volume_from_snapshot" :: held 7.444s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-dfdb23c5-460f-488d-bfcb-61f0254c0efe-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" released by "_create_volume_from_snapshot" :: held 7.486s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.514s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.062s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894589031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb60c592-f0d6-492d-befd-23a2f3564f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:09Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Creating volume fb60c592-f0d6-492d-befd-23a2f3564f95 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:26 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:26 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95 1073741824
Jun 16 18:48:26 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:26 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a055f5cb-0998-4878-9622-91845f6b390c tempest-GroupSnapshotsTest-453261221 None] Create group from source-snapshot-f884b071-1ea0-4adf-afdd-c7823720ccef completed successfully.
Jun 16 18:48:27 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95 1073741824" returned: 0 in 0.733s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:27 devstack sudo[105327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95
Jun 16 18:48:27 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24bfba8-f4b4-400d-bbcf-3556ffd9b29a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:28 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742
Jun 16 18:48:28 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:28 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95" returned: 0 in 0.574s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.114s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645429867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f531ed-e03a-4790-b263-e1c50b0b7deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:09Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Creating volume b5f531ed-e03a-4790-b263-e1c50b0b7deb {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:28 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:28 devstack sudo[105333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb 1073741824
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4f7a34-997f-4fcb-a9c0-223f2c2c228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb60c592-f0d6-492d-befd-23a2f3564f95', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:28 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9c2edb-2785-4c3f-82f6-2112caa68f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:28 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Volume volume-fb60c592-f0d6-492d-befd-23a2f3564f95 (fb60c592-f0d6-492d-befd-23a2f3564f95): created successfully
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9c2edb-2785-4c3f-82f6-2112caa68f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (11d4e163-e6c6-4052-885a-97635c3f1945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:28 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a79bc6c8-e5ac-4e66-9c70-f06a77750b89 tempest-CreateVolumesFromImageTest-2126547624 None] Created volume successfully.
Jun 16 18:48:28 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" returned: 0 in 0.694s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:28 devstack sudo[105338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742
Jun 16 18:48:28 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:28 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb 1073741824" returned: 0 in 0.758s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:29 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb
Jun 16 18:48:29 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:29 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" returned: 0 in 0.620s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-b173f94c-6148-43f9-a7ed-3a9aa5e4b742" released by "delete_volume" :: held 1.360s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['0a923914-6478-4c9a-9245-77548ec6a0c6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:29 devstack cinder-volume[91851]: WARNING cinder.quota [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-333356681 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-333356681, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:48:29 devstack cinder-volume[91851]: WARNING cinder.quota [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-333356681 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-333356681, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['0963cb8f-c693-4bf1-b321-23ad92c3818b', '5423ad87-ebd2-49c9-93a4-4a60c730b27c', 'f218acae-2d65-46a6-97a7-afdc444b5e54', '4147a98b-bf70-4c9c-a63a-65c6cf5b660f'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:29 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:29 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:29 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.201s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1071131465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed496044-d2fd-4166-ab53-ef60c6b74293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:09Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Creating volume ed496044-d2fd-4166-ab53-ef60c6b74293 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:29 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ee3bff-7e4e-4234-b98f-9b00e2d5e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf448d7-ffa3-4161-bbc6-f7b313b391e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:29 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293 1073741824
Jun 16 18:48:29 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:29 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Volume volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb (b5f531ed-e03a-4790-b263-e1c50b0b7deb): created successfully
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf448d7-ffa3-4161-bbc6-f7b313b391e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (99759163-66fe-493d-9b32-c27081b1fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b44ca94f-8cf2-4fbe-85c9-6727550565e1 tempest-CreateVolumesFromImageTest-2126547624 None] Created volume successfully.
Jun 16 18:48:30 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-22913aaa-d2a1-4507-abef-db2bddfa35b6 tempest-GroupSnapshotsTest-453261221 None] Delete group completed successfully.
Jun 16 18:48:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] group_snapshot f884b071-1ea0-4adf-afdd-c7823720ccef: deleting
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] group_snapshot f884b071-1ea0-4adf-afdd-c7823720ccef: deleting {{(pid=91851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-dfdb23c5-460f-488d-bfcb-61f0254c0efe" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-dfdb23c5-460f-488d-bfcb-61f0254c0efe" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Deleting offline snapshot dfdb23c5-460f-488d-bfcb-61f0254c0efe of volume 1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] snapshot_file for this snap is: volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec06dea8-1907-4e1a-9191-a06d08471bf2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:30 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe
Jun 16 18:48:30 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:30 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293 1073741824" returned: 0 in 0.809s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:30 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293
Jun 16 18:48:30 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:31 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe" returned: 0 in 0.751s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:48:31 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.288s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839863227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741bcf07-8189-4810-a550-24e4664728a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:10Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Creating volume 741bcf07-8189-4810-a550-24e4664728a7 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:31 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[893213c7-2ee7-4c3e-8433-9d5019e54a68]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:31 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7 1073741824
Jun 16 18:48:31 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c493a874-c2e7-43ed-98a0-d185c7218ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed496044-d2fd-4166-ab53-ef60c6b74293', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6789661a-c924-44f6-91b1-7d03d54d07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:31 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Volume volume-ed496044-d2fd-4166-ab53-ef60c6b74293 (ed496044-d2fd-4166-ab53-ef60c6b74293): created successfully
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6789661a-c924-44f6-91b1-7d03d54d07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (33d61ca8-6048-4139-bf90-b5dc7091e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-c2f0c387-2b19-4a80-82d4-3ca3dc547bba tempest-CreateVolumesFromImageTest-2126547624 None] Created volume successfully.
Jun 16 18:48:31 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:48:31 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:31 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.744s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:31 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe
Jun 16 18:48:31 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:31 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7 1073741824" returned: 0 in 0.809s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:31 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7
Jun 16 18:48:31 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:32 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7" returned: 0 in 0.576s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.364s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1978539956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716a40c60695486199602802fe01ceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:10Z,use_quota=True,user_id='3dc71407f8a24c3a83354f93f35af702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Creating volume 2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:32 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6626fb5-e6b7-42ee-ab4c-300924999f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741bcf07-8189-4810-a550-24e4664728a7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:32 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b 1073741824
Jun 16 18:48:32 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:32 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1671173-cc68-4c8b-afbd-2c29f1fa9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe" returned: 0 in 0.700s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:32 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Volume volume-741bcf07-8189-4810-a550-24e4664728a7 (741bcf07-8189-4810-a550-24e4664728a7): created successfully
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1671173-cc68-4c8b-afbd-2c29f1fa9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (0c4296e8-5592-4a49-b8ab-9cbe66049091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:32 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe
Jun 16 18:48:32 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:32 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9862ad4a-5503-4ee7-8cf7-1e29012122a7 tempest-CreateVolumesFromImageTest-2126547624 None] Created volume successfully.
Jun 16 18:48:33 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d.dfdb23c5-460f-488d-bfcb-61f0254c0efe" returned: 0 in 0.618s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-dfdb23c5-460f-488d-bfcb-61f0254c0efe" released by "_delete_snapshot" :: held 2.937s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" released by "delete_snapshot" :: held 2.968s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:33 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:33 devstack cinder-volume[91851]: WARNING cinder.quota [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-333356681 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-333356681, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b 1073741824" returned: 0 in 0.743s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] Created reservations ['25219ae8-7f10-4ceb-b013-711016467371', 'e1f440d6-4d93-4f94-b8b4-8f839ea8d34e', '875a0444-a273-464c-b26f-66d24e735edf', '8023db8f-ea93-40a5-8b28-65d139c119d0'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:33 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b
Jun 16 18:48:33 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-34a39880-89e8-4eda-ac1b-5113d5b0836b tempest-GroupSnapshotsTest-453261221 None] group_snapshot f884b071-1ea0-4adf-afdd-c7823720ccef: deleted successfully
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa3e305-b28c-4557-bfe2-455d96db6dd8]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:33 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:48:33 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:33 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b" returned: 0 in 0.617s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.867s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1976563015',display_name='tempest-VolumesGetTest-Volume-2138892746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9997ddc7-152f-4bb4-afd4-6827a0404359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:21Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Creating volume 9997ddc7-152f-4bb4-afd4-6827a0404359 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:33 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:33 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359 1073741824
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac8200c-7ca9-4f5c-84cd-7116d494eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:33 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2554fb-12ba-487b-852f-a0258a116172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:33 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Volume volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b (2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b): created successfully
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2554fb-12ba-487b-852f-a0258a116172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Flow 'volume_create_manager' (58732fba-02f3-4916-bc80-24dc1820127a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-82e5a942-1a23-4cfc-87a4-1345fedf78ca tempest-CreateVolumesFromImageTest-2126547624 None] Created volume successfully.
Jun 16 18:48:34 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.710s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:34 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d
Jun 16 18:48:34 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:34 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359 1073741824" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:34 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359
Jun 16 18:48:34 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:35 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" returned: 0 in 0.603s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-1eb02ee3-5a2b-4bc5-a404-707a0acb042d" released by "delete_volume" :: held 1.387s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-quobyte-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Created reservations ['a26151c9-dfdb-478b-a8e4-f779b57b14d6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[de79dcc4-3c49-4d08-b6c3-257fa351fc50]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:35 devstack cinder-volume[91851]: WARNING cinder.db.sqlalchemy.api [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-333356681']
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Created reservations ['a37144ac-118a-4f35-b52f-2bb9b6fc46d7', 'b8c54534-c5f2-4419-82bf-20ccdc39f4d8', '5d5d09b2-1d01-41e1-8bf2-c63ff0855e07', '40d9ace7-1795-440c-bad7-85a3e4a3227d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:35 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359" returned: 0 in 0.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:35 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b
Jun 16 18:48:35 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7e8933-7ec3-4480-9213-70b737cbdabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9997ddc7-152f-4bb4-afd4-6827a0404359', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434908fe-63a0-432c-b43e-590df19087b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:35 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Volume volume-9997ddc7-152f-4bb4-afd4-6827a0404359 (9997ddc7-152f-4bb4-afd4-6827a0404359): created successfully
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434908fe-63a0-432c-b43e-590df19087b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (5edfe0d7-d4d0-4d78-8d30-850b6965d976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a72863ba-a9db-41b6-b800-9f1016877d90 tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:35 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:35 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:35 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:35 devstack sudo[105421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b
Jun 16 18:48:35 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:36 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b08b773f-5787-4a4d-bffe-c242a9f13e3e tempest-GroupSnapshotsTest-453261221 None] Delete group completed successfully.
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-9997ddc7-152f-4bb4-afd4-6827a0404359-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-789d782d-76bf-4e12-a892-e9ad88121c92 tempest-GroupSnapshotsTest-453261221 None] Group tempest-GroupSnapshotsTest-Group-112417734: creating
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Lock "cinder-9997ddc7-152f-4bb4-afd4-6827a0404359-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-789d782d-76bf-4e12-a892-e9ad88121c92 tempest-GroupSnapshotsTest-453261221 None] Group tempest-GroupSnapshotsTest-Group-112417734: created successfully
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-9997ddc7-152f-4bb4-afd4-6827a0404359" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-789d782d-76bf-4e12-a892-e9ad88121c92 tempest-GroupSnapshotsTest-453261221 None] Create group completed successfully.
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-9997ddc7-152f-4bb4-afd4-6827a0404359" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d54fbc-d47c-42f2-bb2a-c251b1fad8df]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:36 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b" returned: 0 in 0.653s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:36 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359
Jun 16 18:48:36 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b" released by "delete_volume" :: held 1.393s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Created reservations ['e926a003-bc93-491d-810b-1f18f85c90c1', '29f1cd93-6751-491c-ab8f-a365829ec12d', '2cb2dc15-9781-434f-9583-b7e735ae49ca', 'd07cfe8a-2796-4f51-a07e-edd45e8c2d8a'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:36 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:36 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:37 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359" returned: 0 in 0.682s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:37 devstack sudo[105432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359
Jun 16 18:48:37 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:37 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.596s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Deleted volume successfully.
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14080e96-5e28-489f-a06d-df406f22cd7f tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-2efcbc9b-1ff1-44d1-aa07-b6ea6a52a12b-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-741bcf07-8189-4810-a550-24e4664728a7-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-741bcf07-8189-4810-a550-24e4664728a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-quobyte-741bcf07-8189-4810-a550-24e4664728a7" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-741bcf07-8189-4810-a550-24e4664728a7" acquired by "delete_volume" :: waited 0.029s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7c315b-8466-432f-91a7-5c79c96d07f5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:37 devstack sudo[105436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7
Jun 16 18:48:37 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:37 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9997ddc7-152f-4bb4-afd4-6827a0404359" returned: 0 in 0.700s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-9997ddc7-152f-4bb4-afd4-6827a0404359" released by "delete_volume" :: held 1.424s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (17ec71b8-d616-4ca2-b84e-8301eaaf4b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56fac78-53a1-4318-a8b9-c07568ea687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56fac78-53a1-4318-a8b9-c07568ea687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1472114997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5c3396b-337c-406f-9158-ff7b62f17dcd,host='devstack@QuobyteHD#QuobyteHD',id=7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:38Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154c8743-5990-4ade-b681-ebda9a28a0d9),volume_type_id=154c8743-5990-4ade-b681-ebda9a28a0d9)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5f7ae7-2a42-4bd1-ae33-1fe533c0ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5f7ae7-2a42-4bd1-ae33-1fe533c0ade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f000f8-c5a8-484b-970a-2acc30eb5d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f000f8-c5a8-484b-970a-2acc30eb5d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf', 'volume_name': 'volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a04036-78f3-498c-b385-bf73572b796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a04036-78f3-498c-b385-bf73572b796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7118a50-27d5-4d83-9434-8387eb150b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Volume 7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf', 'volume_size': 1}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d5c3396b-337c-406f-9158-ff7b62f17dcd,created_at=2026-06-16T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1472114997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5c3396b-337c-406f-9158-ff7b62f17dcd,host='devstack@QuobyteHD#QuobyteHD',id=7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:38Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154c8743-5990-4ade-b681-ebda9a28a0d9),volume_type_id=154c8743-5990-4ade-b681-ebda9a28a0d9)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Creating volume 7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:37 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:38 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf 1073741824
Jun 16 18:48:38 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Created reservations ['5b037ff9-c3d5-4fae-b5a3-0dcb789b0ef5', '5c57fcf5-3052-47b2-ab26-6e47467e6902', '0b76ec09-5ea0-48c1-a70d-47a05e1cfe7e', 'b911da95-3221-4a73-b99b-cf73944f5e68'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:38 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:38 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:38 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7" returned: 0 in 0.769s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:38 devstack sudo[105447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7
Jun 16 18:48:38 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-4528824d-65ad-4132-9c00-202bc1dbd0af-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Lock "cinder-4528824d-65ad-4132-9c00-202bc1dbd0af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-4528824d-65ad-4132-9c00-202bc1dbd0af" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:38 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.711s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-4528824d-65ad-4132-9c00-202bc1dbd0af" acquired by "delete_volume" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:38 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7dce5-3a2c-4482-b1fc-23b0f90bb007]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0ce59e4d-4fab-444b-9769-9f2ed3a3f32e tempest-VolumesGetTest-698891446 None] Lock "cinder-9997ddc7-152f-4bb4-afd4-6827a0404359-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:38 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf 1073741824" returned: 0 in 0.903s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:38 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf
Jun 16 18:48:38 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:38 devstack sudo[105455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af
Jun 16 18:48:38 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:38 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-741bcf07-8189-4810-a550-24e4664728a7" returned: 0 in 0.680s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-741bcf07-8189-4810-a550-24e4664728a7" released by "delete_volume" :: held 1.503s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Created reservations ['a6a456a8-74a8-4b9a-a694-98627797cd53', 'c1bcd2a7-43c1-480d-a9e8-2fc286722b3d', 'cc4579c5-1cfa-4a17-94b2-241d0cdb2c69', '446bc737-9b36-4701-8d8e-ce8e3c7255f7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:39 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:39 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:39 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" returned: 0 in 0.630s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:39 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af" returned: 0 in 0.719s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7118a50-27d5-4d83-9434-8387eb150b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:39 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af
Jun 16 18:48:39 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616dd0a9-8091-4e6c-82c2-bf913dc7efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Volume volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf (7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf): created successfully
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616dd0a9-8091-4e6c-82c2-bf913dc7efd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (17ec71b8-d616-4ca2-b84e-8301eaaf4b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-ed496044-d2fd-4166-ab53-ef60c6b74293-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e94db883-cf30-41ae-95fb-6d575f1119fe tempest-GroupSnapshotsTest-453261221 None] Created volume successfully.
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-ed496044-d2fd-4166-ab53-ef60c6b74293-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:39 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.617s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Deleted volume successfully.
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-quobyte-ed496044-d2fd-4166-ab53-ef60c6b74293" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-ed496044-d2fd-4166-ab53-ef60c6b74293" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ad8f3651-a1df-4300-8eeb-688ca2fd87e8 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-741bcf07-8189-4810-a550-24e4664728a7-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[19803a05-b66d-4e3e-b25b-20dc1a0063a5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:39 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293
Jun 16 18:48:39 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:40 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4528824d-65ad-4132-9c00-202bc1dbd0af" returned: 0 in 0.633s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-4528824d-65ad-4132-9c00-202bc1dbd0af" released by "delete_volume" :: held 1.431s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Created reservations ['5df49715-2790-46b7-a290-0c29ae0de2c6', '40f73d29-15be-40ec-9152-693096929a06', '6a2c2670-ce25-4cf1-a767-bca964bf5754', 'cc1abedf-9ef3-4d92-8db2-d33ed17ec316'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:40 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:40 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:40 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293" returned: 0 in 0.753s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:40 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293
Jun 16 18:48:40 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (b4f7d361-f06f-4d83-b934-2b39db5a4a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71256709-5726-47ab-939c-4b322f5a1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71256709-5726-47ab-939c-4b322f5a1439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1211825326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5c3396b-337c-406f-9158-ff7b62f17dcd,host='devstack@QuobyteHD#QuobyteHD',id=ec895ba4-4474-49e6-b061-3e552e040d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:40Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154c8743-5990-4ade-b681-ebda9a28a0d9),volume_type_id=154c8743-5990-4ade-b681-ebda9a28a0d9)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1d5125-1c24-4b25-84f2-60c2b5c94ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1d5125-1c24-4b25-84f2-60c2b5c94ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd66498-6463-46cd-86bc-a38180022cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd66498-6463-46cd-86bc-a38180022cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec895ba4-4474-49e6-b061-3e552e040d13', 'volume_name': 'volume-ec895ba4-4474-49e6-b061-3e552e040d13', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ba76e9-a3be-4729-812d-e9ba2e8e0c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ba76e9-a3be-4729-812d-e9ba2e8e0c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c95da5-9ef1-4125-8038-d05df1e05c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:40 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Volume ec895ba4-4474-49e6-b061-3e552e040d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec895ba4-4474-49e6-b061-3e552e040d13', 'volume_size': 1}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d5c3396b-337c-406f-9158-ff7b62f17dcd,created_at=2026-06-16T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1211825326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5c3396b-337c-406f-9158-ff7b62f17dcd,host='devstack@QuobyteHD#QuobyteHD',id=ec895ba4-4474-49e6-b061-3e552e040d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:40Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(154c8743-5990-4ade-b681-ebda9a28a0d9),volume_type_id=154c8743-5990-4ade-b681-ebda9a28a0d9)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Creating volume ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:40 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:40 devstack sudo[105479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 1073741824
Jun 16 18:48:40 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-5c7e330b-30b4-4671-8a21-9f6b8b76ecea-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Lock "cinder-5c7e330b-30b4-4671-8a21-9f6b8b76ecea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:41 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.742s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" acquired by "delete_volume" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-30069626-bb33-43be-aab9-e1655080a44a tempest-VolumesGetTest-698891446 None] Lock "cinder-4528824d-65ad-4132-9c00-202bc1dbd0af-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f12e9cb-c710-453f-932a-a7868b8ff891]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:41 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed496044-d2fd-4166-ab53-ef60c6b74293" returned: 0 in 0.664s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-ed496044-d2fd-4166-ab53-ef60c6b74293" released by "delete_volume" :: held 1.460s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Created reservations ['58e8eb7f-bc4d-497f-88b8-10c92791fa62', '71963b3f-0876-4d04-8fa0-53106745b06b', '8e7865a5-2774-467c-bf61-83967708bbbe', '6ac5314f-d80a-4d24-ba5f-6da108614b2b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:41 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:48:41 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:41 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:41 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:41 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 1073741824" returned: 0 in 0.940s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:41 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13
Jun 16 18:48:41 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-b5f531ed-e03a-4790-b263-e1c50b0b7deb-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-b5f531ed-e03a-4790-b263-e1c50b0b7deb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:41 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:41 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.809s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.644s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Deleted volume successfully.
Jun 16 18:48:42 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea
Jun 16 18:48:42 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-quobyte-b5f531ed-e03a-4790-b263-e1c50b0b7deb" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-b5f531ed-e03a-4790-b263-e1c50b0b7deb" acquired by "delete_volume" :: waited 0.046s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:42 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:42 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7fd38edf-d36a-4272-a3e0-5843146ec241 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-ed496044-d2fd-4166-ab53-ef60c6b74293-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd990b33-163e-47d1-a5f4-2b9d22979131]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:42 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb
Jun 16 18:48:42 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:42 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13" returned: 0 in 0.723s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c95da5-9ef1-4125-8038-d05df1e05c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec895ba4-4474-49e6-b061-3e552e040d13', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b7cb71-ff0a-4522-ae82-3e5afe85f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Volume volume-ec895ba4-4474-49e6-b061-3e552e040d13 (ec895ba4-4474-49e6-b061-3e552e040d13): created successfully
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b7cb71-ff0a-4522-ae82-3e5afe85f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (b4f7d361-f06f-4d83-b934-2b39db5a4a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-952fed10-7432-453d-99ec-368fd740cd22 tempest-GroupSnapshotsTest-453261221 None] Created volume successfully.
Jun 16 18:48:42 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" returned: 0 in 0.701s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-5c7e330b-30b4-4671-8a21-9f6b8b76ecea" released by "delete_volume" :: held 1.581s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:42 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.681s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Created reservations ['b93133b7-80d0-4e43-a511-4add16ce203d', '4917d0d2-c39e-4809-8aab-89b37c7dd270', '9fe554b9-1db8-4ac5-87e3-e2e3ec11879c', '8524da94-577e-4e02-bbf5-2d1802f960e7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-39c8de22-a5d5-467d-b3b6-fcc3af9c35c9 tempest-GroupSnapshotsTest-453261221 None] Update group completed successfully.
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:42 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:42 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:42 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb" returned: 0 in 0.785s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:42 devstack sudo[105511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb
Jun 16 18:48:42 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:43 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.632s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:43 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b5f531ed-e03a-4790-b263-e1c50b0b7deb" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-b5f531ed-e03a-4790-b263-e1c50b0b7deb" released by "delete_volume" :: held 1.468s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-bbd10cc5-b216-46bd-a916-f7f27af61933 tempest-VolumesGetTest-698891446 None] Lock "cinder-5c7e330b-30b4-4671-8a21-9f6b8b76ecea-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Created reservations ['28cc5f2c-ceda-4533-abf0-e700fc3e8513', '9223c2b0-ef24-447f-9c3b-c79136b3bf2c', 'ecadb85d-c478-47cb-9760-c462bd56f0fe', 'b63939ad-ed4d-4567-8f02-eedf4106eae9'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:43 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:43 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (d9a12836-162a-4fa0-a604-c1eba0137b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c260012-a5f9-4c42-b924-b743f72c3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ea28c2fd-14e7-4d5c-9f47-e70a516c52a8 tempest-GroupSnapshotsTest-453261221 None] Update group completed successfully.
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c260012-a5f9-4c42-b924-b743f72c3284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1650613458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f659c52e-c47d-4584-a4e4-cb5b575dfc20,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:44Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e887ba0a-5ecc-4b69-9f6e-16eab5f3c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e887ba0a-5ecc-4b69-9f6e-16eab5f3c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651d9e75-d461-48cf-bbee-71f3ec07861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-fb60c592-f0d6-492d-befd-23a2f3564f95-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-fb60c592-f0d6-492d-befd-23a2f3564f95-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "cinder-quobyte-fb60c592-f0d6-492d-befd-23a2f3564f95" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-fb60c592-f0d6-492d-befd-23a2f3564f95" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e3062-6336-44a9-9701-b291f6086a06]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:44 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.672s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Deleted volume successfully.
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ea722fd0-92a7-424c-8e75-55dc3036783d tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-b5f531ed-e03a-4790-b263-e1c50b0b7deb-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:44 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95
Jun 16 18:48:44 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651d9e75-d461-48cf-bbee-71f3ec07861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f659c52e-c47d-4584-a4e4-cb5b575dfc20', 'volume_name': 'volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b7692b0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea72c564-2e7b-4bd6-b616-8cac6486eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea72c564-2e7b-4bd6-b616-8cac6486eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b395035-ddaa-43a2-acb1-c0c476665800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:44 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Volume f659c52e-c47d-4584-a4e4-cb5b575dfc20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b7692b0>}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Trying to clone f659c52e-c47d-4584-a4e4-cb5b575dfc20 from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:48:44 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Image download 20.69 MB at 20.69 MB/s
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a020a9-e70d-44d3-a882-a9c8912ac1d3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:44 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD
Jun 16 18:48:44 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:44 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95" returned: 0 in 0.712s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:45 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95
Jun 16 18:48:45 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:45 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f7c7f795-baee-4e86-b085-da4e2f69a6ca tempest-GroupSnapshotsTest-453261221 None] Update group completed successfully.
Jun 16 18:48:45 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d is fetched for user 21d96688de664ed4bc04b83d0d3d013a. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fe1ded-b5e3-4db1-a7f4-1f5e111232e3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:45 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-fb60c592-f0d6-492d-befd-23a2f3564f95" returned: 0 in 0.620s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-quobyte-fb60c592-f0d6-492d-befd-23a2f3564f95" released by "delete_volume" :: held 1.390s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Created reservations ['ade0f9f0-d8b1-496e-8433-b5853753aae3', 'c9d46a16-4ce8-4e08-ac2f-ee8cc4ef9fcd', '19072cfe-54c5-401c-8937-d05b7fe3f545', '79dd254c-c7a8-4e7c-a204-1e19064add7f'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:48:45 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD
Jun 16 18:48:45 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:45 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:48:45 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:46 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD" returned: 0 in 0.643s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1650613458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f659c52e-c47d-4584-a4e4-cb5b575dfc20,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:44Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Creating volume f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:46 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:46 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 1073741824
Jun 16 18:48:46 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:46 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.630s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:48:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Deleted volume successfully.
Jun 16 18:48:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbe59173-054b-4bca-8c8a-873577db38b1 tempest-CreateVolumesFromImageTest-2126547624 None] Lock "cinder-fb60c592-f0d6-492d-befd-23a2f3564f95-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:48:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b3551a74-b30f-44e7-ba7a-5c609f92f2ac tempest-GroupSnapshotsTest-453261221 None] Update group completed successfully.
Jun 16 18:48:47 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 1073741824" returned: 0 in 0.872s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:47 devstack sudo[105545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:48:47 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:47 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 0 in 0.648s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:47 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] GroupSnapshot 7300b298-2778-4bf1-999d-5992080a9cf6: creating.
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Attempting download of 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume f659c52e-c47d-4584-a4e4-cb5b575dfc20. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Group snapshot 7300b298-2778-4bf1-999d-5992080a9cf6: creating. {{(pid=91851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Creating offline snapshot 2bebeef9-900c-4c06-8cfe-3f6534192e15 of volume 7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aefbe16-8e8e-4288-aab3-db9f19beac06]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe69d98-ed86-405e-b4ad-a8910877bd8a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:48 devstack sudo[105550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8
Jun 16 18:48:48 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:48 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf
Jun 16 18:48:48 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:48 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8" returned: 0 in 0.703s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:48 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" returned: 0 in 0.737s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:48 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 1G
Jun 16 18:48:48 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:48 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8
Jun 16 18:48:48 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:49 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8" returned: 1 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_sqzx90c8' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:48:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4701141-224a-4c48-9a97-e3a2c0b97e0b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:49 devstack sudo[105569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD
Jun 16 18:48:49 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:49 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 1G" returned: 0 in 0.843s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:49 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15
Jun 16 18:48:49 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:50 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d was qcow2, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:50 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:48:50 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:50 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15" returned: 0 in 0.700s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:50 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:50 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15
Jun 16 18:48:50 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:50 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15" returned: 0 in 0.687s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:50 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info
Jun 16 18:48:50 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:51 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info" returned: 0 in 0.706s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:51 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:51 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info
Jun 16 18:48:51 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:52 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 0 in 2.050s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_mmnzki2adevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:48:52 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Converted 112.00 MB image at 54.60 MB/s
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:52 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 1G
Jun 16 18:48:52 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:52 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.info" returned: 0 in 0.846s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.650s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Creating offline snapshot 865cb7fc-0916-4b04-ae4d-af89b618c788 of volume ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c5b88-db5e-4799-b6ab-c56a3605e85f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:52 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13
Jun 16 18:48:52 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:52 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 1G" returned: 0 in 0.725s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f524f1-57af-48a1-8cd5-a8c5b3ad7a02]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:53 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:48:53 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:53 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13" returned: 0 in 0.803s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:53 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 1G
Jun 16 18:48:53 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:53 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 0 in 0.896s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:53 devstack sudo[105618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:48:53 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:54 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 1G" returned: 0 in 0.961s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec895ba4-4474-49e6-b061-3e552e040d13 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:54 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec895ba4-4474-49e6-b061-3e552e040d13 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788
Jun 16 18:48:54 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:54 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 1 in 0.820s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Downloaded image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume f659c52e-c47d-4584-a4e4-cb5b575dfc20 successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d for user 21d96688de664ed4bc04b83d0d3d013a is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Marking volume f659c52e-c47d-4584-a4e4-cb5b575dfc20 as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=149,cinder:INSERT=46,cinder:UPDATE=175,cinder:DELETE=15 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Copying metadata from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d to f659c52e-c47d-4584-a4e4-cb5b575dfc20. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Creating volume glance metadata for volume f659c52e-c47d-4584-a4e4-cb5b575dfc20 backed by image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=158,cinder:SELECT=131,cinder:INSERT=39,cinder:DELETE=8 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b395035-ddaa-43a2-acb1-c0c476665800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b7692b0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300ab05c-3805-4e8a-9bf2-f03d1f310b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:54 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Volume volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 (f659c52e-c47d-4584-a4e4-cb5b575dfc20): created successfully
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300ab05c-3805-4e8a-9bf2-f03d1f310b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (d9a12836-162a-4fa0-a604-c1eba0137b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-555841dc-406a-4575-a539-3da48188f047 tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:48:55 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec895ba4-4474-49e6-b061-3e552e040d13 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788" returned: 0 in 0.768s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:55 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:55 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788
Jun 16 18:48:55 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:55 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788" returned: 0 in 0.648s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:55 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info
Jun 16 18:48:55 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:56 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:56 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:56 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info
Jun 16 18:48:56 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (f242c88a-1626-4377-bc7c-74386b574196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6573b5c-4064-44b3-bad7-5dd75b53c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6573b5c-4064-44b3-bad7-5dd75b53c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-531573636',display_name='tempest-VolumesGetTest-Volume-713071070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40c1526-b6c5-4d69-aa45-8e8a9ee50758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:57Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f13498-6e2f-4d09-8fcc-f94e78bdc9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f13498-6e2f-4d09-8fcc-f94e78bdc9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7344fc92-45be-4937-be13-5fc1395f8b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7344fc92-45be-4937-be13-5fc1395f8b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40c1526-b6c5-4d69-aa45-8e8a9ee50758', 'volume_name': 'volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bb87e4-d9cf-4684-938a-bc5afd60c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bb87e4-d9cf-4684-938a-bc5afd60c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7279b1c2-6a95-4bee-95ad-2ec64d050973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Volume c40c1526-b6c5-4d69-aa45-8e8a9ee50758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758', 'volume_size': 1}
Jun 16 18:48:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:57 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.info" returned: 0 in 0.667s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.586s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:48:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-531573636',display_name='tempest-VolumesGetTest-Volume-713071070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40c1526-b6c5-4d69-aa45-8e8a9ee50758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb329930cf541c89f11772f065af7f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:48:57Z,use_quota=True,user_id='21d96688de664ed4bc04b83d0d3d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Creating volume c40c1526-b6c5-4d69-aa45-8e8a9ee50758 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:48:57 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:57 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 1073741824
Jun 16 18:48:57 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6398a513-fb08-4a32-b246-037396d60172 tempest-GroupSnapshotsTest-453261221 None] group_snapshot 7300b298-2778-4bf1-999d-5992080a9cf6: created successfully
Jun 16 18:48:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] group_snapshot 7300b298-2778-4bf1-999d-5992080a9cf6: deleting
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] group_snapshot 7300b298-2778-4bf1-999d-5992080a9cf6: deleting {{(pid=91851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-2bebeef9-900c-4c06-8cfe-3f6534192e15" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-2bebeef9-900c-4c06-8cfe-3f6534192e15" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Deleting offline snapshot 2bebeef9-900c-4c06-8cfe-3f6534192e15 of volume 7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] snapshot_file for this snap is: volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73bc263-8608-4f02-8876-4aac1e447b36]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:57 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15
Jun 16 18:48:57 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:57 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 1073741824" returned: 0 in 0.833s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:58 devstack sudo[105649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758
Jun 16 18:48:58 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:58 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15" returned: 0 in 0.765s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2d6d5-ce76-4a5f-b76a-8b1b3c708f30]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:58 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf
Jun 16 18:48:58 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:58 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758" returned: 0 in 0.718s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7279b1c2-6a95-4bee-95ad-2ec64d050973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288766d3-cb15-48e3-b8e0-a984161dc023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:48:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Volume volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 (c40c1526-b6c5-4d69-aa45-8e8a9ee50758): created successfully
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288766d3-cb15-48e3-b8e0-a984161dc023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:48:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Flow 'volume_create_manager' (f242c88a-1626-4377-bc7c-74386b574196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:48:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-05bd832e-09ab-4f40-b9e7-08ae7ec23762 tempest-VolumesGetTest-698891446 None] Created volume successfully.
Jun 16 18:48:59 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" returned: 0 in 0.797s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:59 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15
Jun 16 18:48:59 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:48:59 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Jun 16 18:48:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15" returned: 0 in 0.734s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:48:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:48:59 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15
Jun 16 18:48:59 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-c40c1526-b6c5-4d69-aa45-8e8a9ee50758-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Lock "cinder-c40c1526-b6c5-4d69-aa45-8e8a9ee50758-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-c40c1526-b6c5-4d69-aa45-8e8a9ee50758" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-c40c1526-b6c5-4d69-aa45-8e8a9ee50758" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02aee86-5f07-4e72-b1f6-88d208d7d8ed]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:00 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758
Jun 16 18:49:00 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:00 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf.2bebeef9-900c-4c06-8cfe-3f6534192e15" returned: 0 in 0.691s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-2bebeef9-900c-4c06-8cfe-3f6534192e15" released by "_delete_snapshot" :: held 3.137s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" released by "delete_snapshot" :: held 3.165s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-ec895ba4-4474-49e6-b061-3e552e040d13" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-ec895ba4-4474-49e6-b061-3e552e040d13" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-865cb7fc-0916-4b04-ae4d-af89b618c788" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-865cb7fc-0916-4b04-ae4d-af89b618c788" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Deleting offline snapshot 865cb7fc-0916-4b04-ae4d-af89b618c788 of volume ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] snapshot_file for this snap is: volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1058ab59-2d63-47c0-a8f0-ab2dcffb6bf0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:00 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788
Jun 16 18:49:00 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:00 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758" returned: 0 in 0.757s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:00 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758
Jun 16 18:49:00 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:01 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec895ba4-4474-49e6-b061-3e552e040d13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:01 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c40c1526-b6c5-4d69-aa45-8e8a9ee50758" returned: 0 in 0.653s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a3266-96da-4aca-ba5a-77ff4cb1952e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-c40c1526-b6c5-4d69-aa45-8e8a9ee50758" released by "delete_volume" :: held 1.495s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Created reservations ['86c679e0-cf89-4864-baaf-c4eda68dd199', 'abcc9cbd-6508-4b22-9e1b-ae1a0ce26b98', '39afcd93-2f84-42a0-891b-764ec0540117', 'e0c665dc-1b4c-49b9-90ab-46a00337ed04'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:01 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13
Jun 16 18:49:01 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:01 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:01 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-f659c52e-c47d-4584-a4e4-cb5b575dfc20-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:02 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:02 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:49:02 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Lock "cinder-f659c52e-c47d-4584-a4e4-cb5b575dfc20-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13" returned: 0 in 0.865s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-910380f8-bc6b-4593-821b-05db6f5d75f1 tempest-VolumesGetTest-698891446 None] Lock "cinder-c40c1526-b6c5-4d69-aa45-8e8a9ee50758-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:02 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788
Jun 16 18:49:02 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Acquiring lock "cinder-quobyte-f659c52e-c47d-4584-a4e4-cb5b575dfc20" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-f659c52e-c47d-4584-a4e4-cb5b575dfc20" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb537f0-eb57-4a94-bd8f-05b653e4abf9]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:02 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:49:02 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:03 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788" returned: 0 in 0.776s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:03 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788
Jun 16 18:49:03 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:03 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:03 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:49:03 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:03 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13.865cb7fc-0916-4b04-ae4d-af89b618c788" returned: 0 in 0.593s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-865cb7fc-0916-4b04-ae4d-af89b618c788" released by "_delete_snapshot" :: held 3.150s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-ec895ba4-4474-49e6-b061-3e552e040d13" released by "delete_snapshot" :: held 3.177s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:03 devstack cinder-volume[91851]: WARNING cinder.quota [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1389638686 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1389638686, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:49:03 devstack cinder-volume[91851]: WARNING cinder.quota [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1389638686 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1389638686, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['f93b401d-e51f-4821-a732-f588f631d2e8', 'c4ed3ebf-e2f1-4650-90a8-bdc248012ae6', 'e0396fd6-3da1-4d01-aca8-03232f2cd2e4', '7781ccaf-b654-41bd-b2e2-4f64ed615b3b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['091ca65b-3a55-4fe6-8f23-0b3ae17f4ca3', '5adceab6-fd69-4192-b905-5071e57a743a', 'be9841b2-0d20-452e-bc89-1ce3ce1a1b83', 'f8a8bd80-652e-4d5e-b82a-8db07e33135e'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:04 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 1 in 0.766s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:04 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20
Jun 16 18:49:04 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7e79a98f-5d08-41f7-aaf6-6fb0c3dc6eb9 tempest-GroupSnapshotsTest-453261221 None] group_snapshot 7300b298-2778-4bf1-999d-5992080a9cf6: deleted successfully
Jun 16 18:49:04 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f659c52e-c47d-4584-a4e4-cb5b575dfc20" returned: 0 in 0.646s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Lock "cinder-quobyte-f659c52e-c47d-4584-a4e4-cb5b575dfc20" released by "delete_volume" :: held 2.254s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Created reservations ['3dc982c0-f7ff-4943-97b8-77f882ff3722', '0d894581-5a1a-4085-8bc1-f4d016a2d703', '2d175401-a7ee-4f7e-a995-d28ced627bfd', '1ee269e5-e6fd-4760-a4cf-c1bd52afccf1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:05 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:05 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f3584-d80e-42a6-ba17-7e204be3fda1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:05 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf
Jun 16 18:49:05 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:05 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.655s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Deleted volume successfully.
Jun 16 18:49:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-eb19a596-4e1c-4c76-a8d9-5f4a665e2914 tempest-VolumesGetTest-698891446 None] Lock "cinder-f659c52e-c47d-4584-a4e4-cb5b575dfc20-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:06 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" returned: 0 in 0.820s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:06 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf
Jun 16 18:49:06 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:07 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" returned: 0 in 0.712s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-7ac6c7c7-2ebc-42d5-91c3-7f8957f551cf" released by "delete_volume" :: held 1.636s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-ec895ba4-4474-49e6-b061-3e552e040d13" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-ec895ba4-4474-49e6-b061-3e552e040d13" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118935b-8c11-4ad5-803a-7d7f13b638c2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:07 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13
Jun 16 18:49:07 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:07 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13" returned: 0 in 0.802s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:07 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13
Jun 16 18:49:07 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:08 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ec895ba4-4474-49e6-b061-3e552e040d13" returned: 0 in 0.809s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-ec895ba4-4474-49e6-b061-3e552e040d13" released by "delete_volume" :: held 1.707s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:08 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['077a14da-b0b3-43bd-a1e3-9e90fa2b2cf5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:08 devstack cinder-volume[91851]: WARNING cinder.quota [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1389638686 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1389638686, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:49:08 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['0ab5206c-b51b-49cb-9871-78d5b4bc5796', 'fa551baf-f599-43d2-bbb0-02a35d3e32d3', '4830495f-894d-4e9a-a98c-6ce270017365', '19bc0e08-2cd5-4eef-a3d0-ed983e9faa96'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['379adec2-0a38-443d-9447-6261b048651c', '272a0834-a4a8-4e32-ba2c-766d96e76238', '454a1f36-20cb-4d54-99ea-02fdb363ec66', '0c63d4be-8d18-4424-8a66-b90b3ed6574c'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:09 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:09 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:09 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.687s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:09 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:09 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e2b82d5a-8c52-4267-a8d3-4999fef29484 tempest-GroupSnapshotsTest-453261221 None] Delete group completed successfully.
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Flow 'volume_create_manager' (ac9851bd-f5f5-4a5d-8170-9f0b795c39be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b548d-2ba3-45aa-9b8c-a123953edf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1b548d-2ba3-45aa-9b8c-a123953edf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-62640976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e0cb3-416d-4fba-8334-614e7ec8b62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092df3c5705742739e20b3c6239ac612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:10Z,use_quota=True,user_id='887011e0e4fb48f189e590cf55ca3798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12892958-bf48-4c76-8ff1-beca9843c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12892958-bf48-4c76-8ff1-beca9843c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ff0c5c-a072-44c1-8294-6356135f3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ff0c5c-a072-44c1-8294-6356135f3184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2e0cb3-416d-4fba-8334-614e7ec8b62a', 'volume_name': 'volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5899c2-b36b-43af-8bc4-1f5f6398f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5899c2-b36b-43af-8bc4-1f5f6398f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6917fe7-0725-4c22-8efd-fe6ea8156205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Volume 0b2e0cb3-416d-4fba-8334-614e7ec8b62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a', 'volume_size': 1}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-62640976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e0cb3-416d-4fba-8334-614e7ec8b62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092df3c5705742739e20b3c6239ac612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:10Z,use_quota=True,user_id='887011e0e4fb48f189e590cf55ca3798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Creating volume 0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:49:10 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:49:10 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a 1073741824
Jun 16 18:49:10 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Flow 'volume_create_manager' (824112e5-bdc5-4e79-8a2d-30645b943aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6deb678a-2856-49cc-8c27-c0be05cfbbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6deb678a-2856-49cc-8c27-c0be05cfbbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1846498689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b96e703-3b87-4197-9932-546c6ce817e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228e2177c46d4f92a46f31a5cd7eb4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:10Z,use_quota=True,user_id='7383f11eabf846a4860bde8ed5400c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292149bc-6980-45eb-84d8-8492330f3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292149bc-6980-45eb-84d8-8492330f3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f880c882-70d9-48fa-9912-0e1be6034550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f880c882-70d9-48fa-9912-0e1be6034550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b96e703-3b87-4197-9932-546c6ce817e7', 'volume_name': 'volume-5b96e703-3b87-4197-9932-546c6ce817e7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59cc8ff-d480-4ed1-9f90-52b61af4a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59cc8ff-d480-4ed1-9f90-52b61af4a506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7e8f39-9895-438e-998a-58815c85a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Volume 5b96e703-3b87-4197-9932-546c6ce817e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b96e703-3b87-4197-9932-546c6ce817e7', 'volume_size': 1}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8a20be1a-93d4-49d8-8fef-d6f1990afe32 tempest-GroupSnapshotsTest-453261221 None] Group tempest-GroupSnapshotsTest-Group-1315761601: creating
Jun 16 18:49:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8a20be1a-93d4-49d8-8fef-d6f1990afe32 tempest-GroupSnapshotsTest-453261221 None] Group tempest-GroupSnapshotsTest-Group-1315761601: created successfully
Jun 16 18:49:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8a20be1a-93d4-49d8-8fef-d6f1990afe32 tempest-GroupSnapshotsTest-453261221 None] Create group completed successfully.
Jun 16 18:49:10 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a 1073741824" returned: 0 in 0.781s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:11 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:11 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:11 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.578s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1846498689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b96e703-3b87-4197-9932-546c6ce817e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228e2177c46d4f92a46f31a5cd7eb4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:10Z,use_quota=True,user_id='7383f11eabf846a4860bde8ed5400c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Creating volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:49:11 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6917fe7-0725-4c22-8efd-fe6ea8156205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:11 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 1073741824
Jun 16 18:49:11 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9742d48-0cf4-4057-8f51-5b93b921d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:11 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Volume volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a (0b2e0cb3-416d-4fba-8334-614e7ec8b62a): created successfully
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9742d48-0cf4-4057-8f51-5b93b921d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Flow 'volume_create_manager' (ac9851bd-f5f5-4a5d-8170-9f0b795c39be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:11 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3fa22b09-f49f-443b-bb02-b0e14e97c553 tempest-SnapshotDependencyTests-1694279214 None] Created volume successfully.
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (172d0142-7d70-4b82-acab-be497118b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dbb83e-fa83-4503-9366-6d06d16da275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dbb83e-fa83-4503-9366-6d06d16da275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1203537814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f0c4626-fe7b-455d-8db9-8ee20c997e5b,host='devstack@QuobyteHD#QuobyteHD',id=5c33027e-e497-48b5-afa5-32c918d172c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:12Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31aa0447-18d2-46e9-a5b2-b69669945e90),volume_type_id=31aa0447-18d2-46e9-a5b2-b69669945e90)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6d9d29-ba1a-4c46-af33-4a2a72760386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6d9d29-ba1a-4c46-af33-4a2a72760386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c3ad3-a01f-4c60-aa41-73646a5bf6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c3ad3-a01f-4c60-aa41-73646a5bf6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c33027e-e497-48b5-afa5-32c918d172c9', 'volume_name': 'volume-5c33027e-e497-48b5-afa5-32c918d172c9', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9b0d9c-8848-42ab-9200-753bd40a5864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9b0d9c-8848-42ab-9200-753bd40a5864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff6715c-b762-41cb-ab6b-197eaad4a8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:12 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Volume 5c33027e-e497-48b5-afa5-32c918d172c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c33027e-e497-48b5-afa5-32c918d172c9', 'volume_size': 1}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:12 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 1073741824" returned: 0 in 0.863s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:12 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7
Jun 16 18:49:12 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:13 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7" returned: 0 in 0.569s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0f0c4626-fe7b-455d-8db9-8ee20c997e5b,created_at=2026-06-16T16:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1203537814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f0c4626-fe7b-455d-8db9-8ee20c997e5b,host='devstack@QuobyteHD#QuobyteHD',id=5c33027e-e497-48b5-afa5-32c918d172c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359032656f9e4b47852b4d05ab4a1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:12Z,use_quota=True,user_id='a10cf1694f1c4369854c5bfdc86bbd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31aa0447-18d2-46e9-a5b2-b69669945e90),volume_type_id=31aa0447-18d2-46e9-a5b2-b69669945e90)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Creating volume 5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:49:13 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7e8f39-9895-438e-998a-58815c85a623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b96e703-3b87-4197-9932-546c6ce817e7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:13 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 1073741824
Jun 16 18:49:13 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cac64b3-df52-4a01-ade2-6546ca7a8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:13 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Volume volume-5b96e703-3b87-4197-9932-546c6ce817e7 (5b96e703-3b87-4197-9932-546c6ce817e7): created successfully
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cac64b3-df52-4a01-ade2-6546ca7a8563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Flow 'volume_create_manager' (824112e5-bdc5-4e79-8a2d-30645b943aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:13 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-56e8ba2f-9d0b-4ace-b86b-0c50634f94f4 tempest-VolumesSnapshotListTestJSON-1230445777 None] Created volume successfully.
Jun 16 18:49:13 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 1073741824" returned: 0 in 0.780s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:13 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9
Jun 16 18:49:13 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:14 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9" returned: 0 in 0.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.067s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff6715c-b762-41cb-ab6b-197eaad4a8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c33027e-e497-48b5-afa5-32c918d172c9', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb041c43-9f77-4a3e-a201-25f2653f6b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Creating offline snapshot fa283d20-278a-469b-95c8-4d40329ef1c1 of volume 0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:14 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Volume volume-5c33027e-e497-48b5-afa5-32c918d172c9 (5c33027e-e497-48b5-afa5-32c918d172c9): created successfully
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb041c43-9f77-4a3e-a201-25f2653f6b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Flow 'volume_create_manager' (172d0142-7d70-4b82-acab-be497118b112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a7fe8f-41d6-40b3-9de6-0f6ca669b3ac]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-c794a51c-da84-41f5-a676-e7cdb5517aaf tempest-GroupSnapshotsTest-453261221 None] Created volume successfully.
Jun 16 18:49:14 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:14 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:15 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.752s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:15 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 1G
Jun 16 18:49:15 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] GroupSnapshot a93034ac-7f1c-4d50-9126-62ab33c3b90a: creating.
Jun 16 18:49:15 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Group snapshot a93034ac-7f1c-4d50-9126-62ab33c3b90a: creating. {{(pid=91851) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}}
Jun 16 18:49:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:16 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 1G" returned: 0 in 0.779s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:16 devstack sudo[105779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1
Jun 16 18:49:16 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:16 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1" returned: 0 in 0.607s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:16 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 is being set with open permissions: ugo+rw
Jun 16 18:49:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:16 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1
Jun 16 18:49:16 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:17 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1" returned: 0 in 0.559s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:17 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info
Jun 16 18:49:17 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:17 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info" returned: 0 in 0.579s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:17 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info is being set with open permissions: ugo+rw
Jun 16 18:49:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:17 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info
Jun 16 18:49:17 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:18 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.info" returned: 0 in 0.562s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.940s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.976s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Creating offline snapshot a628a9f5-4750-49b9-ae04-af66e86a02d7 of volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2971dd8a-8dd3-46d3-ab07-e36d286973f0 tempest-SnapshotDependencyTests-1694279214 None] Create snapshot completed successfully
Jun 16 18:49:18 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9d73e7-283f-4d6d-aa32-b46b77e888b2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:18 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7
Jun 16 18:49:18 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Flow 'volume_create_manager' (bf59854f-9dbd-4a5d-bcc4-0b6841df39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6b9c13-50af-497d-b3d6-9e70a6dc7876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:19 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7" returned: 0 in 0.736s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6b9c13-50af-497d-b3d6-9e70a6dc7876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbc1dd3-bc7b-4701-9931-31be22ba3af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092df3c5705742739e20b3c6239ac612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa283d20-278a-469b-95c8-4d40329ef1c1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:19Z,use_quota=True,user_id='887011e0e4fb48f189e590cf55ca3798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:19 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 1G
Jun 16 18:49:19 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8714980e-167c-46bc-8858-8d949ca2807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8714980e-167c-46bc-8858-8d949ca2807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe9eca6-5643-47d6-bfb0-42d3479b725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe9eca6-5643-47d6-bfb0-42d3479b725e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'edbc1dd3-bc7b-4701-9931-31be22ba3af1', 'volume_name': 'volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1', 'volume_size': 1, 'snapshot_id': 'fa283d20-278a-469b-95c8-4d40329ef1c1'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c710ffc8-4305-48f9-a748-8d732d594264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c710ffc8-4305-48f9-a748-8d732d594264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ec3eb5-f718-4b9c-bf5a-2e6944191699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Volume edbc1dd3-bc7b-4701-9931-31be22ba3af1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1', 'volume_size': 1, 'snapshot_id': 'fa283d20-278a-469b-95c8-4d40329ef1c1'}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:19 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 1G" returned: 0 in 0.720s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:19 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:19 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:20 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.639s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:20 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 is being set with open permissions: ugo+rw
Jun 16 18:49:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:20 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:20 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:21 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.580s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:21 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info
Jun 16 18:49:21 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:21 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:21 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info is being set with open permissions: ugo+rw
Jun 16 18:49:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:21 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info
Jun 16 18:49:21 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:22 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.info" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.968s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.925s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Creating offline snapshot 828a66e6-6daf-42c4-8975-105c6c213c74 of volume 5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7b885ca8-31b1-44cb-9350-d19b96cf4449 tempest-VolumesSnapshotListTestJSON-1230445777 None] Create snapshot completed successfully
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a2cd3-d683-4236-a589-adec007dae6d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:22 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9
Jun 16 18:49:22 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:23 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9" returned: 0 in 0.724s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:23 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 1G
Jun 16 18:49:23 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:23 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 1G" returned: 0 in 0.749s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33027e-e497-48b5-afa5-32c918d172c9 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:23 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33027e-e497-48b5-afa5-32c918d172c9 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74
Jun 16 18:49:23 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:24 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33027e-e497-48b5-afa5-32c918d172c9 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74" returned: 0 in 0.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:24 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:49:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:24 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74
Jun 16 18:49:24 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:25 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74" returned: 0 in 0.584s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:25 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info
Jun 16 18:49:25 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:25 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:25 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 16 18:49:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:25 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info
Jun 16 18:49:25 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:26 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.info" returned: 0 in 0.590s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.953s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.084s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-quobyte-fa283d20-278a-469b-95c8-4d40329ef1c1-edbc1dd3-bc7b-4701-9931-31be22ba3af1" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-fa283d20-278a-469b-95c8-4d40329ef1c1-edbc1dd3-bc7b-4701-9931-31be22ba3af1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Creating volume edbc1dd3-bc7b-4701-9931-31be22ba3af1 from snapshot fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-quobyte-edbc1dd3-bc7b-4701-9931-31be22ba3af1" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-edbc1dd3-bc7b-4701-9931-31be22ba3af1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] snapshot: fa283d20-278a-469b-95c8-4d40329ef1c1, volume: edbc1dd3-bc7b-4701-9931-31be22ba3af1,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c48b58b-8dc1-4329-a813-dad73c81c7ef]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:26 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d42e4d0e-8433-4492-9745-af6f0ae3d3fe tempest-GroupSnapshotsTest-453261221 None] group_snapshot a93034ac-7f1c-4d50-9126-62ab33c3b90a: created successfully
Jun 16 18:49:26 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1
Jun 16 18:49:26 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] group_snapshot a93034ac-7f1c-4d50-9126-62ab33c3b90a: deleting
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] group_snapshot a93034ac-7f1c-4d50-9126-62ab33c3b90a: deleting {{(pid=91851) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-5c33027e-e497-48b5-afa5-32c918d172c9" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-5c33027e-e497-48b5-afa5-32c918d172c9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-828a66e6-6daf-42c4-8975-105c6c213c74" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-828a66e6-6daf-42c4-8975-105c6c213c74" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Deleting offline snapshot 828a66e6-6daf-42c4-8975-105c6c213c74 of volume 5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] snapshot_file for this snap is: volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce66792-efa4-440f-8905-e345294e59da]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:27 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1" returned: 0 in 0.750s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d945ad-27bb-442b-b1e5-25c03e95363e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:27 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74
Jun 16 18:49:27 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:27 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:27 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:27 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74" returned: 0 in 0.728s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33027e-e497-48b5-afa5-32c918d172c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f324f2e-fd95-4e92-98a5-0dfcc26da316]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:27 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.721s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:49:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:27 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1
Jun 16 18:49:27 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:28 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9
Jun 16 18:49:28 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:28 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9" returned: 0 in 0.698s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:28 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74
Jun 16 18:49:28 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:29 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74" returned: 0 in 1.261s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:29 devstack sudo[105922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74
Jun 16 18:49:29 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:31 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9.828a66e6-6daf-42c4-8975-105c6c213c74" returned: 0 in 1.209s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-828a66e6-6daf-42c4-8975-105c6c213c74" released by "_delete_snapshot" :: held 4.054s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-5c33027e-e497-48b5-afa5-32c918d172c9" released by "delete_snapshot" :: held 4.109s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:31 devstack cinder-volume[91851]: WARNING cinder.quota [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-75092797 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-75092797, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:49:31 devstack cinder-volume[91851]: WARNING cinder.quota [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-75092797 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-75092797, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:49:31 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] Created reservations ['c37a0502-5efc-474e-ba02-28259ebc95d9', 'cb9a2dc7-8f15-44dd-8d9e-ce5bf7a41054', '2ad06393-57e1-424d-ad49-afdf19d8fb62', '76e2a8be-d8c5-4db7-9fe8-2905399e4cf1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1493b476-bed5-4b49-9a6d-c531dd2025c5 tempest-GroupSnapshotsTest-453261221 None] group_snapshot a93034ac-7f1c-4d50-9126-62ab33c3b90a: deleted successfully
Jun 16 18:49:32 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1" returned: 0 in 4.847s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c011531-477a-431b-aba1-c11b73224ff7]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "cinder-quobyte-5c33027e-e497-48b5-afa5-32c918d172c9" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:32 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:32 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-5c33027e-e497-48b5-afa5-32c918d172c9" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac8e93-ad57-4f83-ac4e-9fbddf635430]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:33 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9
Jun 16 18:49:33 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:33 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.878s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:33 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:33 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:49:33 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Converted 1024.00 MB image at 211.24 MB/s
Jun 16 18:49:33 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 is being set with open permissions: ugo+rw
Jun 16 18:49:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:33 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1
Jun 16 18:49:33 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:33 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9
Jun 16 18:49:33 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:34 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:34 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-edbc1dd3-bc7b-4701-9931-31be22ba3af1" released by "_copy_volume_from_snapshot" :: held 7.923s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5c33027e-e497-48b5-afa5-32c918d172c9" returned: 0 in 0.608s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-fa283d20-278a-469b-95c8-4d40329ef1c1-edbc1dd3-bc7b-4701-9931-31be22ba3af1" released by "_create_volume_from_snapshot" :: held 7.960s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.980s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.410s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Lock "cinder-quobyte-5c33027e-e497-48b5-afa5-32c918d172c9" released by "delete_volume" :: held 1.415s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Creating offline snapshot 79fe73e0-1383-48c1-8f25-954ef2797936 of volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a730143e-05c1-4c15-bfae-8e15f5c5fe24]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ec3eb5-f718-4b9c-bf5a-2e6944191699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1', 'volume_size': 1, 'snapshot_id': 'fa283d20-278a-469b-95c8-4d40329ef1c1'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e34990-d3df-4990-adc3-1abef5d5ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:34 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Volume volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 (edbc1dd3-bc7b-4701-9931-31be22ba3af1): created successfully
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e34990-d3df-4990-adc3-1abef5d5ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Flow 'volume_create_manager' (bf59854f-9dbd-4a5d-bcc4-0b6841df39ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0b0fcf51-f779-4b85-87cd-2a06d63c9ed7 tempest-SnapshotDependencyTests-1694279214 None] Created volume successfully.
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Created reservations ['982155ed-b408-448f-82b1-f7d46ffea24d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:34 devstack cinder-volume[91851]: WARNING cinder.quota [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-75092797 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-75092797, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:49:34 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:34 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Created reservations ['01043fa3-64a5-4a64-bd9c-5594e0a09fc8', '809dcb92-d601-4429-a32c-37c711b1fa9c', '03602aad-0ee6-476a-a778-bb2545f3334e', '26179318-3a7d-40bc-9c0d-2ed4370a311d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:34 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:34 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:35 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.717s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:35 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 1G
Jun 16 18:49:35 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:35 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.620s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6bb51289-ddda-47ef-a941-c801040143cd tempest-GroupSnapshotsTest-453261221 None] Delete group completed successfully.
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-fa283d20-278a-469b-95c8-4d40329ef1c1-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-fa283d20-278a-469b-95c8-4d40329ef1c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-quobyte-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-quobyte-fa283d20-278a-469b-95c8-4d40329ef1c1" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-fa283d20-278a-469b-95c8-4d40329ef1c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Deleting offline snapshot fa283d20-278a-469b-95c8-4d40329ef1c1 of volume 0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] snapshot_file for this snap is: volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9705b342-931e-4afe-a4e2-48bbf662f54c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:35 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1
Jun 16 18:49:35 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:35 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 1G" returned: 0 in 0.896s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:36 devstack sudo[105960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:36 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:36 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1" returned: 0 in 0.765s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f1833-8761-4dcf-b276-c1c5f1b11502]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:36 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:36 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:36 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.734s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:36 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 is being set with open permissions: ugo+rw
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:36 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:36 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:36 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.839s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:37 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1
Jun 16 18:49:37 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:37 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.163s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-15660a4e-21b4-477f-a30a-2d928ddec4d7 tempest-VolumesSnapshotListTestJSON-1230445777 None] Create snapshot completed successfully
Jun 16 18:49:37 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:37 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1
Jun 16 18:49:37 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Creating offline snapshot cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 of volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efb541b-4272-4190-9e09-989c2a20ebf8]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:38 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:38 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:38 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a.fa283d20-278a-469b-95c8-4d40329ef1c1" returned: 0 in 0.656s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-fa283d20-278a-469b-95c8-4d40329ef1c1" released by "_delete_snapshot" :: held 3.168s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" released by "delete_snapshot" :: held 3.195s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Created reservations ['caf593e7-3981-47ef-b41d-c6b412d93fc5', '1268f5a9-f797-423f-ae00-8b4c64cd9faa', '33140f64-9786-47a1-a455-696814379da3', '91c91d3e-e07d-4156-83c3-eda6f50c9ec8'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:38 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Delete snapshot completed successfully.
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbca5463-b9ea-4d50-a445-b815fdc77ce0 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-fa283d20-278a-469b-95c8-4d40329ef1c1-delete_snapshot" released by "delete_snapshot" :: held 3.341s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:38 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:38 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 1G
Jun 16 18:49:38 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:39 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 1G" returned: 0 in 0.808s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:39 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3
Jun 16 18:49:39 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-0b2e0cb3-416d-4fba-8334-614e7ec8b62a-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-0b2e0cb3-416d-4fba-8334-614e7ec8b62a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-quobyte-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d01c33-54a7-47d4-a0d7-fc7e729ec03d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:39 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:39 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:40 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" returned: 0 in 0.666s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:40 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 is being set with open permissions: ugo+rw
Jun 16 18:49:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:40 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3
Jun 16 18:49:40 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:40 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.801s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:40 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a
Jun 16 18:49:40 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:40 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:40 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-bb3f1003-0cd8-4ebf-83a4-b8548c46e2c2 tempest-VolumesSnapshotListTestJSON-1230445777 None] Create snapshot completed successfully
Jun 16 18:49:41 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" returned: 0 in 0.690s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-0b2e0cb3-416d-4fba-8334-614e7ec8b62a" released by "delete_volume" :: held 1.564s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Created reservations ['721b2f74-a6bf-412a-b828-aae75b66fa65', 'e298d468-ca61-4006-aa8c-c179b095c0f5', '24807ccf-6edc-44ef-8b9c-0b1831564409', 'bb39f41d-b41b-421f-b9cb-7c8ced93a660'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:41 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:41 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-edbc1dd3-bc7b-4701-9931-31be22ba3af1-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-edbc1dd3-bc7b-4701-9931-31be22ba3af1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "cinder-quobyte-edbc1dd3-bc7b-4701-9931-31be22ba3af1" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-edbc1dd3-bc7b-4701-9931-31be22ba3af1" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-cfd18f3b-f3c3-415a-8da8-a35ca462dcc3-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc61ffd-cf3a-4256-95fd-0c9e4d6463e6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:42 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.710s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-cfd18f3b-f3c3-415a-8da8-a35ca462dcc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Deleted volume successfully.
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" acquired by "delete_snapshot" :: waited 0.048s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4259a78c-e95c-4e66-8c43-bf3ecb585777 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-0b2e0cb3-416d-4fba-8334-614e7ec8b62a-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:42 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:42 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Deleting offline snapshot cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 of volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:49:42 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1
Jun 16 18:49:42 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] snapshot_file for this snap is: volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e65d0f-fbb9-4088-acdb-70f078daddae]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:42 devstack sudo[106021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3
Jun 16 18:49:42 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:42 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.807s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:49:42 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1" returned: 0 in 0.889s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:42 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1
Jun 16 18:49:42 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:42 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" returned: 0 in 0.777s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2afdd-d4a5-4d1b-aeb4-834297232632]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:43 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:43 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:43 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-edbc1dd3-bc7b-4701-9931-31be22ba3af1" returned: 0 in 0.659s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-quobyte-edbc1dd3-bc7b-4701-9931-31be22ba3af1" released by "delete_volume" :: held 1.605s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Created reservations ['7064116c-b7b0-408a-ab90-f2277bfea700', 'b24f905f-4b22-409f-a741-dcb4f2201ed7', '1e5ea538-fdd9-435d-a57f-609906c9057d', 'c866d2ba-cd17-4452-9893-007db01526a6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:43 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:43 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:43 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.756s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:43 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3
Jun 16 18:49:43 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:44 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.677s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:44 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Deleted volume successfully.
Jun 16 18:49:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dc90220b-2627-4ed0-985c-4dbd3c7f60a1 tempest-SnapshotDependencyTests-1694279214 None] Lock "cinder-edbc1dd3-bc7b-4701-9931-31be22ba3af1-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:44 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" returned: 0 in 0.825s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:44 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3
Jun 16 18:49:44 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:45 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" returned: 0 in 0.623s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-cfd18f3b-f3c3-415a-8da8-a35ca462dcc3" released by "_delete_snapshot" :: held 3.137s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" released by "delete_snapshot" :: held 3.179s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:45 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Created reservations ['c6893235-1782-42a9-a3c2-53d1e9c0003a', '91a546fe-0bb2-49b9-b7a0-85b04076da40', 'e57071be-c3f8-443c-9926-91887d03e83b', '0fc58f52-14d2-4d60-99ee-0e3361784386'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:45 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Delete snapshot completed successfully.
Jun 16 18:49:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-edcc0036-1375-4c65-a30f-94bb68d772c3 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-cfd18f3b-f3c3-415a-8da8-a35ca462dcc3-delete_snapshot" released by "delete_snapshot" :: held 3.361s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-79fe73e0-1383-48c1-8f25-954ef2797936-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-79fe73e0-1383-48c1-8f25-954ef2797936-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-79fe73e0-1383-48c1-8f25-954ef2797936" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-79fe73e0-1383-48c1-8f25-954ef2797936" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Deleting offline snapshot 79fe73e0-1383-48c1-8f25-954ef2797936 of volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] snapshot_file for this snap is: volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f93b2-973e-4063-b494-0f58b45c7483]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:46 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:46 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:47 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.836s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b540f-0c63-46c1-86a3-fb7bbf1e4f1b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:47 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:47 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:48 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.859s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:48 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:48 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:48 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.882s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:48 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936
Jun 16 18:49:48 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:49 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.79fe73e0-1383-48c1-8f25-954ef2797936" returned: 0 in 0.665s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-79fe73e0-1383-48c1-8f25-954ef2797936" released by "_delete_snapshot" :: held 3.355s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" released by "delete_snapshot" :: held 3.381s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:49 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Created reservations ['ef97fb59-a62b-482a-8c0e-778cbc5a6cf9', '25b90648-50f9-4cff-b0b7-34b98e1778a0', '42152fe9-6b40-4cf3-b88a-66600cdff38d', '5861f0ef-8b95-468a-988b-1f2c4cebb215'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:49 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Delete snapshot completed successfully.
Jun 16 18:49:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f5e643aa-0995-4b45-bcce-e5fd4b378b22 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-79fe73e0-1383-48c1-8f25-954ef2797936-delete_snapshot" released by "delete_snapshot" :: held 3.530s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-a628a9f5-4750-49b9-ae04-af66e86a02d7-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-a628a9f5-4750-49b9-ae04-af66e86a02d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-a628a9f5-4750-49b9-ae04-af66e86a02d7" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-a628a9f5-4750-49b9-ae04-af66e86a02d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Deleting offline snapshot a628a9f5-4750-49b9-ae04-af66e86a02d7 of volume 5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] snapshot_file for this snap is: volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b17eae-e6f9-406d-9c4b-7bb9ca378edd]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:50 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:50 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:51 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.782s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b96e703-3b87-4197-9932-546c6ce817e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f6caa9-27eb-4359-986a-8dbcf829738e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Flow 'volume_create_manager' (afd69776-b1a8-4302-b443-7dbdb1537418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b142d31-1a9d-4e1e-9e51-cac728e52964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:51 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7
Jun 16 18:49:51 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b142d31-1a9d-4e1e-9e51-cac728e52964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1096361459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b5cd88-227e-4f3d-a2cf-c32e968d54e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff098caaf2a461b96789c34cdc955d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:51Z,use_quota=True,user_id='6c67596943d74d6180f2303065bc961e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70b8845-9a1c-4246-b118-329e198b5d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70b8845-9a1c-4246-b118-329e198b5d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95315d88-b205-4a71-8fe8-8450da35d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95315d88-b205-4a71-8fe8-8450da35d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b5cd88-227e-4f3d-a2cf-c32e968d54e2', 'volume_name': 'volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05d8786-768f-4eea-86f9-e8c025469daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05d8786-768f-4eea-86f9-e8c025469daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796883bb-afd2-4115-a6e8-88a3994e3dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:51 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2', 'volume_size': 1}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1096361459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b5cd88-227e-4f3d-a2cf-c32e968d54e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff098caaf2a461b96789c34cdc955d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:49:51Z,use_quota=True,user_id='6c67596943d74d6180f2303065bc961e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Creating volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:49:51 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:49:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:51 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 1073741824
Jun 16 18:49:51 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:52 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7" returned: 0 in 0.791s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:52 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:52 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:52 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 1073741824" returned: 0 in 0.910s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:52 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2
Jun 16 18:49:52 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:53 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.852s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:53 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7
Jun 16 18:49:53 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:53 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" returned: 0 in 0.773s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796883bb-afd2-4115-a6e8-88a3994e3dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a048ee96-cab6-4713-ba83-51be892fffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:53 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Volume volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 (72b5cd88-227e-4f3d-a2cf-c32e968d54e2): created successfully
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a048ee96-cab6-4713-ba83-51be892fffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Flow 'volume_create_manager' (afd69776-b1a8-4302-b443-7dbdb1537418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-cf2b8f0e-6633-4bd8-a167-59bec5436e75 tempest-SnapshotsActionsTest-754358026 None] Created volume successfully.
Jun 16 18:49:53 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7.a628a9f5-4750-49b9-ae04-af66e86a02d7" returned: 0 in 0.707s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-a628a9f5-4750-49b9-ae04-af66e86a02d7" released by "_delete_snapshot" :: held 3.313s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" released by "delete_snapshot" :: held 3.348s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Creating offline snapshot c1df876e-487c-4cfd-bec6-118b202d6817 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b67f1fb-610f-4cfd-a288-821b0bb7d3d7]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:53 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Created reservations ['c19242f0-497e-40e6-bc72-cfde39d1c7a9', '40999a80-12cf-4202-a18a-b9c2195b3a1a', '37854df0-65b7-4f4c-8b83-168b63a2dcf6', 'be4c85a2-040c-411e-bee0-8f6549317803'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Delete snapshot completed successfully.
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6583ec09-249b-4733-add9-afd9b954e58f tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-a628a9f5-4750-49b9-ae04-af66e86a02d7-delete_snapshot" released by "delete_snapshot" :: held 3.530s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:54 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2
Jun 16 18:49:54 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:54 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" returned: 0 in 0.729s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:54 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 1G
Jun 16 18:49:54 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-5b96e703-3b87-4197-9932-546c6ce817e7-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-5b96e703-3b87-4197-9932-546c6ce817e7-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=128,cinder:INSERT=37,cinder:UPDATE=136,cinder:DELETE=3 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=124,cinder:INSERT=42,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:49:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a4236f-6bf6-4fcb-8a39-65bdd8554096]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:55 devstack sudo[106110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7
Jun 16 18:49:55 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:55 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 1G" returned: 0 in 0.769s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:55 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:49:55 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:55 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7" returned: 0 in 0.698s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:55 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7
Jun 16 18:49:55 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:56 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.647s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:56 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 is being set with open permissions: ugo+rw
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:56 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:49:56 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:56 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5b96e703-3b87-4197-9932-546c6ce817e7" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-quobyte-5b96e703-3b87-4197-9932-546c6ce817e7" released by "delete_volume" :: held 1.357s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Created reservations ['6e701953-c068-4689-ad85-23bb1499d522', 'eb1ddbdf-3a07-4449-bb33-5d4b83cad53d', 'd84cdb8d-5625-4626-a1d2-1a2041d58540', '1f6e1d46-bd9a-490f-9a6b-a8d649d69625'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:56 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:49:56 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:56 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.600s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:56 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info
Jun 16 18:49:56 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:57 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.582s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:49:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Deleted volume successfully.
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-380ec766-9be5-4eeb-8484-93de3663d000 tempest-VolumesSnapshotListTestJSON-1230445777 None] Lock "cinder-5b96e703-3b87-4197-9932-546c6ce817e7-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:49:57 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info" returned: 0 in 0.596s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:57 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info is being set with open permissions: ugo+rw
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:57 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info
Jun 16 18:49:57 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:57 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.info" returned: 0 in 0.597s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.030s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:49:57 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ae76caa4-9b6e-4fb5-b065-56925376a833 tempest-SnapshotsActionsTest-754358026 None] Create snapshot completed successfully
Jun 16 18:49:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:49:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:49:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Creating offline snapshot ee212d08-7772-4189-8443-3822474f4e42 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:49:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ba0aa-d0b7-48db-81f5-bf4b0d487965]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:49:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:59 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:49:59 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:59 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.753s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:49:59 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 1G
Jun 16 18:49:59 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Flow 'volume_create_manager' (f86b11a5-1a4f-4dfd-aabe-cf2278748ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ae94d6-e9f4-40cd-a0ce-ad8ec937e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ae94d6-e9f4-40cd-a0ce-ad8ec937e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-6461414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a95da7-05e8-4e60-b016-005bbf302f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06eac649faea4101a3dde0b79023de91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:00Z,use_quota=True,user_id='264b420cce9f49a29cbdeae6117130fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f510789-a0b0-4a7b-b325-8fc6a3e973d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f510789-a0b0-4a7b-b325-8fc6a3e973d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88fe7e8-247b-46ca-910d-2884d7023692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88fe7e8-247b-46ca-910d-2884d7023692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a95da7-05e8-4e60-b016-005bbf302f98', 'volume_name': 'volume-f1a95da7-05e8-4e60-b016-005bbf302f98', 'volume_size': 2}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffafe6c-cc3a-4957-a104-f7945f94dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffafe6c-cc3a-4957-a104-f7945f94dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461eee13-861e-4da6-9a7f-76f59821d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:49:59 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Volume f1a95da7-05e8-4e60-b016-005bbf302f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a95da7-05e8-4e60-b016-005bbf302f98', 'volume_size': 2}
Jun 16 18:49:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:00 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 1G" returned: 0 in 0.743s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:00 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42
Jun 16 18:50:00 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:01 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42" returned: 0 in 0.625s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:01 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 is being set with open permissions: ugo+rw
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:01 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42
Jun 16 18:50:01 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:01 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42" returned: 0 in 0.565s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-6461414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a95da7-05e8-4e60-b016-005bbf302f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06eac649faea4101a3dde0b79023de91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:00Z,use_quota=True,user_id='264b420cce9f49a29cbdeae6117130fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Creating volume f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:50:01 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:50:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 2147483648 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:01 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 2147483648
Jun 16 18:50:01 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f1a3b781-1819-4a91-93a1-94e63fb026c7 tempest-SnapshotsActionsTest-754358026 None] Create snapshot completed successfully
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-ee212d08-7772-4189-8443-3822474f4e42-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-ee212d08-7772-4189-8443-3822474f4e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-ee212d08-7772-4189-8443-3822474f4e42" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-ee212d08-7772-4189-8443-3822474f4e42" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Deleting offline snapshot ee212d08-7772-4189-8443-3822474f4e42 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] snapshot_file for this snap is: volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c2d13d-9d36-40d8-b088-cdfaabac4acc]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:02 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42
Jun 16 18:50:02 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:02 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 2147483648" returned: 0 in 0.803s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:02 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98
Jun 16 18:50:02 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:02 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42" returned: 0 in 0.712s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b869bd-7ea3-43bb-9fe8-85df56e0b11b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:03 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:03 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:03 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461eee13-861e-4da6-9a7f-76f59821d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a95da7-05e8-4e60-b016-005bbf302f98', 'volume_size': 2}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dcef03-9ae2-480c-a080-85a385201aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:03 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Volume volume-f1a95da7-05e8-4e60-b016-005bbf302f98 (f1a95da7-05e8-4e60-b016-005bbf302f98): created successfully
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dcef03-9ae2-480c-a080-85a385201aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Flow 'volume_create_manager' (f86b11a5-1a4f-4dfd-aabe-cf2278748ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7e14bec6-7db6-4448-8971-24206435b35b tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Created volume successfully.
Jun 16 18:50:03 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.693s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:03 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42
Jun 16 18:50:03 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Creating offline snapshot b95c4e93-5eb2-4296-9171-9a7d9e6d68ca of volume f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16afb6-9ba7-4791-94c2-c21601c8ba4e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:04 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98
Jun 16 18:50:04 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:04 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42" returned: 0 in 0.733s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:04 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42
Jun 16 18:50:04 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:04 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca 2G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:04 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca 2G
Jun 16 18:50:04 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:04 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.ee212d08-7772-4189-8443-3822474f4e42" returned: 0 in 0.596s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-ee212d08-7772-4189-8443-3822474f4e42" released by "_delete_snapshot" :: held 2.840s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" released by "delete_snapshot" :: held 2.861s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Created reservations ['867c349e-058d-4057-b76e-23cfb7da96b8', '451fca28-78ec-491c-9191-7429a429a5d9', '3ff647f1-6a4c-4d7b-ba1d-fd03243ba344', '1e577c93-62fc-4e02-9979-79886ab26f8f'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Delete snapshot completed successfully.
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7d613946-9e6f-46fb-85d2-d81e7c0355f4 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-ee212d08-7772-4189-8443-3822474f4e42-delete_snapshot" released by "delete_snapshot" :: held 2.988s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:05 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca 2G" returned: 0 in 0.802s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a95da7-05e8-4e60-b016-005bbf302f98 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:05 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a95da7-05e8-4e60-b016-005bbf302f98 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca
Jun 16 18:50:05 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:06 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a95da7-05e8-4e60-b016-005bbf302f98 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" returned: 0 in 0.620s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:06 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca is being set with open permissions: ugo+rw
Jun 16 18:50:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:06 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca
Jun 16 18:50:06 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:06 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" returned: 0 in 0.589s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:07 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info
Jun 16 18:50:07 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:07 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info" returned: 0 in 0.582s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:07 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info is being set with open permissions: ugo+rw
Jun 16 18:50:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:07 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info
Jun 16 18:50:07 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:08 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.info" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.986s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.576s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Creating offline snapshot a2bf4d26-194a-4f78-91c2-ab649ddcf07c of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[511085ab-12a6-4dc4-8cce-74adfa4a452d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:08 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f6c3b1b7-03fa-4c1a-84b3-ca9b326f4a69 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Create snapshot completed successfully
Jun 16 18:50:08 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:08 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "cinder-b95c4e93-5eb2-4296-9171-9a7d9e6d68ca-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-b95c4e93-5eb2-4296-9171-9a7d9e6d68ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "cinder-quobyte-f1a95da7-05e8-4e60-b016-005bbf302f98" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-quobyte-f1a95da7-05e8-4e60-b016-005bbf302f98" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "cinder-quobyte-b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-quobyte-b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Deleting offline snapshot b95c4e93-5eb2-4296-9171-9a7d9e6d68ca of volume f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] snapshot_file for this snap is: volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde8327d-936c-4d1c-a4b2-84b85d375508]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:08 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca
Jun 16 18:50:08 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:08 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.691s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:08 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c 1G
Jun 16 18:50:08 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:09 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" returned: 0 in 0.717s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a95da7-05e8-4e60-b016-005bbf302f98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf966e09-d0d3-4c03-b317-ae3845029952]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:09 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98
Jun 16 18:50:09 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:09 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c 1G" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:09 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c
Jun 16 18:50:09 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:09 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98" returned: 0 in 0.707s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:09 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca
Jun 16 18:50:09 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:10 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c" returned: 0 in 0.638s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:10 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c is being set with open permissions: ugo+rw
Jun 16 18:50:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:10 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c
Jun 16 18:50:10 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:10 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" returned: 0 in 0.668s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:10 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca
Jun 16 18:50:10 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:10 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c" returned: 0 in 0.587s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4843dae5-0b4b-49bb-8f30-e5af633b2378 tempest-SnapshotsActionsTest-754358026 None] Create snapshot completed successfully
Jun 16 18:50:11 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98.b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" returned: 0 in 0.607s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-quobyte-b95c4e93-5eb2-4296-9171-9a7d9e6d68ca" released by "_delete_snapshot" :: held 2.786s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-quobyte-f1a95da7-05e8-4e60-b016-005bbf302f98" released by "delete_snapshot" :: held 2.808s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Created reservations ['8003a703-e82d-4f6f-9650-c7fa052da67f', '5be95b1a-54e7-464e-8301-aa5a074e46b9', '73ed6fd2-2944-4d47-a76a-233ceaede742', '249eb042-8c25-4e24-9c34-7d88fc5cbcc3'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:11 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Delete snapshot completed successfully.
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-dfc9b0e9-f2fc-4759-ac35-93e9a91299e0 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-b95c4e93-5eb2-4296-9171-9a7d9e6d68ca-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "cinder-f1a95da7-05e8-4e60-b016-005bbf302f98-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-f1a95da7-05e8-4e60-b016-005bbf302f98-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "cinder-quobyte-f1a95da7-05e8-4e60-b016-005bbf302f98" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-quobyte-f1a95da7-05e8-4e60-b016-005bbf302f98" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a8b74-35fa-4ac6-86f4-e157f7251df4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:11 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98
Jun 16 18:50:11 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-a2bf4d26-194a-4f78-91c2-ab649ddcf07c-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-a2bf4d26-194a-4f78-91c2-ab649ddcf07c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-a2bf4d26-194a-4f78-91c2-ab649ddcf07c" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-a2bf4d26-194a-4f78-91c2-ab649ddcf07c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Deleting offline snapshot a2bf4d26-194a-4f78-91c2-ab649ddcf07c of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] snapshot_file for this snap is: volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d714abf6-ce29-4b25-9afa-fd9aa6fb7f6e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:12 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c
Jun 16 18:50:12 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:12 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:12 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98
Jun 16 18:50:12 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:12 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea86d72-e91a-4bdd-aa79-6f6b2103b1b2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:12 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:12 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:13 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f1a95da7-05e8-4e60-b016-005bbf302f98" returned: 0 in 0.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-quobyte-f1a95da7-05e8-4e60-b016-005bbf302f98" released by "delete_volume" :: held 1.344s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Created reservations ['33a91aa6-7c5c-462e-9a66-cd2b34dbd4fc', '50cb6ce3-d6c1-4a10-9ff5-6589347f2c5e', '9bac3ff1-282b-4896-975a-ec9e8b875f16', '81b678ce-ae66-445c-87bb-a330ff8e47e7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:13 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:50:13 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:13 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:13 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c
Jun 16 18:50:13 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:13 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:50:13 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Deleted volume successfully.
Jun 16 18:50:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-51da5fe0-d572-4372-9cae-2d33e9003df6 tempest-VolumesSnapshotNegativeTestJSON-1751337478 None] Lock "cinder-f1a95da7-05e8-4e60-b016-005bbf302f98-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:14 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c" returned: 0 in 0.759s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:14 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c
Jun 16 18:50:14 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:14 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.a2bf4d26-194a-4f78-91c2-ab649ddcf07c" returned: 0 in 0.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-a2bf4d26-194a-4f78-91c2-ab649ddcf07c" released by "_delete_snapshot" :: held 2.877s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" released by "delete_snapshot" :: held 2.898s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:14 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Created reservations ['822f18e2-400b-45ab-8b19-1cfe61b8363b', 'df41bf72-7a2f-4db6-a371-8eb70b5bad84', '7a93e4b2-0d69-4e3a-8409-a429378b2412', '1ee6cee1-7ef3-49f9-ad65-f6d65e4fe6af'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Delete snapshot completed successfully.
Jun 16 18:50:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0f28ee88-2964-48f9-828b-2a2113a09e24 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-a2bf4d26-194a-4f78-91c2-ab649ddcf07c-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Creating offline snapshot d1243855-2d7d-4581-9d11-3be16e5ef403 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:50:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2df2d7-668c-4beb-a98f-393bcf28f56f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:15 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:15 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:16 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.720s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:16 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 1G
Jun 16 18:50:16 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:16 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 1G" returned: 0 in 0.818s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:17 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403
Jun 16 18:50:17 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:17 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403" returned: 0 in 0.676s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:17 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 is being set with open permissions: ugo+rw
Jun 16 18:50:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:17 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403
Jun 16 18:50:17 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:18 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8c989ad5-a73d-4b61-b777-4013de406d5f tempest-SnapshotsActionsTest-754358026 None] Create snapshot completed successfully
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-d1243855-2d7d-4581-9d11-3be16e5ef403-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-d1243855-2d7d-4581-9d11-3be16e5ef403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-d1243855-2d7d-4581-9d11-3be16e5ef403" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-d1243855-2d7d-4581-9d11-3be16e5ef403" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Deleting offline snapshot d1243855-2d7d-4581-9d11-3be16e5ef403 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] snapshot_file for this snap is: volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf86743-3876-492e-9897-643abe4ae755]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:18 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403
Jun 16 18:50:18 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:19 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403" returned: 0 in 0.750s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:19 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b3f87-feca-40f1-9146-6487d381e518]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:19 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:19 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:20 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.703s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:20 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403
Jun 16 18:50:20 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:21 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403" returned: 0 in 0.828s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:21 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403
Jun 16 18:50:21 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:21 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.d1243855-2d7d-4581-9d11-3be16e5ef403" returned: 0 in 0.619s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-d1243855-2d7d-4581-9d11-3be16e5ef403" released by "_delete_snapshot" :: held 3.002s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" released by "delete_snapshot" :: held 3.028s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Created reservations ['3723fd45-65ce-4ed6-9f27-fbfb299f97f7', '62d42beb-e499-4b55-ab9f-15708edb4f76', '78ab016f-0158-41b3-938c-408e99ed89b7', 'fba9a7d7-c287-449a-97dc-50543a1da2fa'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Delete snapshot completed successfully.
Jun 16 18:50:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-207fc54e-2ac7-4487-85c3-549d0f776319 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-d1243855-2d7d-4581-9d11-3be16e5ef403-delete_snapshot" released by "delete_snapshot" :: held 3.170s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Creating offline snapshot 446fa8ef-9f7b-440d-b63b-7add7cf16669 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[613937bb-fe37-4701-a939-5e6b8122ce15]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:23 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:23 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:23 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.730s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:23 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 1G
Jun 16 18:50:23 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:24 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 1G" returned: 0 in 0.857s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:24 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669
Jun 16 18:50:24 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:25 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669" returned: 0 in 0.649s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:25 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 is being set with open permissions: ugo+rw
Jun 16 18:50:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:25 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669
Jun 16 18:50:25 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:26 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669" returned: 0 in 0.607s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:26 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-cf73f47e-388c-4b37-8725-b8c7e50d2322 tempest-SnapshotsActionsTest-754358026 None] Create snapshot completed successfully
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-446fa8ef-9f7b-440d-b63b-7add7cf16669-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-446fa8ef-9f7b-440d-b63b-7add7cf16669-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Acquiring lock "cinder-quobyte-446fa8ef-9f7b-440d-b63b-7add7cf16669" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-446fa8ef-9f7b-440d-b63b-7add7cf16669" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Deleting offline snapshot 446fa8ef-9f7b-440d-b63b-7add7cf16669 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] snapshot_file for this snap is: volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860dbdf-330d-4350-b552-c4a6febf210a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:26 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669
Jun 16 18:50:26 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:27 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669" returned: 0 in 0.739s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d69e648-a1ad-4a56-ab06-3970f13d51e4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:27 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:27 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:27 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.732s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:28 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669
Jun 16 18:50:28 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:28 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669" returned: 0 in 0.779s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:28 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669
Jun 16 18:50:28 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:29 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.446fa8ef-9f7b-440d-b63b-7add7cf16669" returned: 0 in 0.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-446fa8ef-9f7b-440d-b63b-7add7cf16669" released by "_delete_snapshot" :: held 2.972s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" released by "delete_snapshot" :: held 2.999s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Created reservations ['fe5522b0-b565-4ff3-9daf-c3d7c9aa7456', '100510b7-4373-4787-8bb5-ad7cef771602', 'a1dca0b1-42ad-40e5-b322-5ceca4604d3f', '3f217bed-99b9-4764-9fe1-5c8070e13fc7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Delete snapshot completed successfully.
Jun 16 18:50:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fe62caf1-4c9a-406e-ba2e-11b5e268d064 tempest-SnapshotsActionsTest-596001020 None] Lock "cinder-446fa8ef-9f7b-440d-b63b-7add7cf16669-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "cinder-c1df876e-487c-4cfd-bec6-118b202d6817-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-c1df876e-487c-4cfd-bec6-118b202d6817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "cinder-quobyte-c1df876e-487c-4cfd-bec6-118b202d6817" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-quobyte-c1df876e-487c-4cfd-bec6-118b202d6817" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Deleting offline snapshot c1df876e-487c-4cfd-bec6-118b202d6817 of volume 72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] snapshot_file for this snap is: volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[af23f094-8f8b-49cf-8088-55fd46f3c1a7]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:30 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:30 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:30 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3c5d0-4a2d-458a-9a28-c61a9b518a82]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:30 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2
Jun 16 18:50:30 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:31 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" returned: 0 in 0.827s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:31 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:31 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:32 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.733s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:32 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817
Jun 16 18:50:32 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:33 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2.c1df876e-487c-4cfd-bec6-118b202d6817" returned: 0 in 0.629s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-quobyte-c1df876e-487c-4cfd-bec6-118b202d6817" released by "_delete_snapshot" :: held 3.022s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" released by "delete_snapshot" :: held 3.045s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:33 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Created reservations ['3325f612-2516-4255-879f-6d038a1ea3fa', 'ead3f19f-7aac-4937-a2c6-d07c51b36fc1', 'cf0a1e61-243b-4660-93ae-97d2d0a083e0', '08239b29-eae8-499f-96c1-b3a4b8a36d67'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Delete snapshot completed successfully.
Jun 16 18:50:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-97d415d9-da6e-423f-b054-144136b85025 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-c1df876e-487c-4cfd-bec6-118b202d6817-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "cinder-72b5cd88-227e-4f3d-a2cf-c32e968d54e2-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-72b5cd88-227e-4f3d-a2cf-c32e968d54e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:50:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:50:34 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fc7ab9-90ea-4fbb-a155-9c0734717c9f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:34 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2
Jun 16 18:50:34 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:35 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" returned: 0 in 0.710s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:35 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2
Jun 16 18:50:35 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:35 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" returned: 0 in 0.652s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-quobyte-72b5cd88-227e-4f3d-a2cf-c32e968d54e2" released by "delete_volume" :: held 1.429s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Created reservations ['21ec7c54-3ef2-4384-8923-74e6d893fa37', 'b8c24f59-a946-46ad-82b7-d9aad58887b0', 'cf6dba10-9553-4b0a-b4d0-c2bdd306595f', 'df87af02-4bc3-47c6-943e-987ddf1fce2d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:35 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:50:35 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:36 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:36 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:50:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Deleted volume successfully.
Jun 16 18:50:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0a4c1411-38bc-4729-8247-5b99b86719e1 tempest-SnapshotsActionsTest-754358026 None] Lock "cinder-72b5cd88-227e-4f3d-a2cf-c32e968d54e2-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Flow 'volume_create_manager' (e3d3c79d-1508-4164-b754-78ebd36318e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481fab22-447e-4022-a00b-d6ccde666524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481fab22-447e-4022-a00b-d6ccde666524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-225843009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b473a-229a-4577-9cb9-13b9ae5b98a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def2b2feabe413dba2554a0d86d6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:40Z,use_quota=True,user_id='2b5a91309ee9448d816461e6e2442d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6b6f2-d619-4816-b4da-9c7b985152a4),volume_type_id=a1f6b6f2-d619-4816-b4da-9c7b985152a4)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3c48b1-1192-410e-8771-e51b54bef3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3c48b1-1192-410e-8771-e51b54bef3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eae243-922a-46fc-9143-96a5055e4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eae243-922a-46fc-9143-96a5055e4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4b473a-229a-4577-9cb9-13b9ae5b98a0', 'volume_name': 'volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f59eebc-5783-4425-8fa7-fda394eff69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f59eebc-5783-4425-8fa7-fda394eff69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47a2ac6-1887-4e8f-a0e2-6a29c3dd4fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Volume 6c4b473a-229a-4577-9cb9-13b9ae5b98a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0', 'volume_size': 1}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-225843009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b473a-229a-4577-9cb9-13b9ae5b98a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def2b2feabe413dba2554a0d86d6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:40Z,use_quota=True,user_id='2b5a91309ee9448d816461e6e2442d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1f6b6f2-d619-4816-b4da-9c7b985152a4),volume_type_id=a1f6b6f2-d619-4816-b4da-9c7b985152a4)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Creating volume 6c4b473a-229a-4577-9cb9-13b9ae5b98a0 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:50:40 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:40 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 1073741824
Jun 16 18:50:40 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Flow 'volume_create_manager' (21ea9566-1e42-4905-a7bb-5d42f4e93b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7b2b92-20d4-46f0-84a3-96cc29527668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7b2b92-20d4-46f0-84a3-96cc29527668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-363293880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5474441e-039d-4577-8e12-82a9cd5fef92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def2b2feabe413dba2554a0d86d6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:41Z,use_quota=True,user_id='2b5a91309ee9448d816461e6e2442d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3711420-4b50-4670-aefd-813891e23f1e),volume_type_id=a3711420-4b50-4670-aefd-813891e23f1e)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e918860-fc1d-410e-ad30-26809cd4f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e918860-fc1d-410e-ad30-26809cd4f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62896b9-bd3a-4d61-99fa-f0f66a933240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62896b9-bd3a-4d61-99fa-f0f66a933240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5474441e-039d-4577-8e12-82a9cd5fef92', 'volume_name': 'volume-5474441e-039d-4577-8e12-82a9cd5fef92', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a94c4-42f3-4556-b12d-a658cc43a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a94c4-42f3-4556-b12d-a658cc43a792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b85fd0-46c7-4b58-a79b-b53296e54451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:40 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Volume 5474441e-039d-4577-8e12-82a9cd5fef92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5474441e-039d-4577-8e12-82a9cd5fef92', 'volume_size': 1}
Jun 16 18:50:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:41 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 1073741824" returned: 0 in 0.997s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Flow 'volume_create_manager' (a78c09a9-d115-495b-857a-1537c2f69751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ff6c64-ebf0-4f5f-980c-748d3ba69f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ff6c64-ebf0-4f5f-980c-748d3ba69f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1019385382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db354e74-403c-40f9-b71b-d8aea569337a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def2b2feabe413dba2554a0d86d6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:41Z,use_quota=True,user_id='2b5a91309ee9448d816461e6e2442d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36412be5-9ba0-468a-952c-d7ec543bb1d1),volume_type_id=36412be5-9ba0-468a-952c-d7ec543bb1d1)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668d4763-a08c-4b42-a8b8-83aa31675400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668d4763-a08c-4b42-a8b8-83aa31675400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d585351e-4cfd-4643-8b99-5654d07fc766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:41 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0
Jun 16 18:50:41 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d585351e-4cfd-4643-8b99-5654d07fc766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db354e74-403c-40f9-b71b-d8aea569337a', 'volume_name': 'volume-db354e74-403c-40f9-b71b-d8aea569337a', 'volume_size': 1, 'image_id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2134196392', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8def2b2feabe413dba2554a0d86d6900', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'created_at': datetime.datetime(2026, 6, 16, 16, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b696f30>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d870872a-6170-4634-a48c-444072b7ade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d870872a-6170-4634-a48c-444072b7ade0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da4420f-9b00-4904-98ac-eb6489dcdeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:41 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Volume db354e74-403c-40f9-b71b-d8aea569337a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db354e74-403c-40f9-b71b-d8aea569337a', 'volume_size': 1, 'image_id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2134196392', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8def2b2feabe413dba2554a0d86d6900', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'created_at': datetime.datetime(2026, 6, 16, 16, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b696f30>}
Jun 16 18:50:41 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Trying to clone db354e74-403c-40f9-b71b-d8aea569337a from image 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:42 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:42 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:50:42 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-363293880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5474441e-039d-4577-8e12-82a9cd5fef92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def2b2feabe413dba2554a0d86d6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:41Z,use_quota=True,user_id='2b5a91309ee9448d816461e6e2442d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3711420-4b50-4670-aefd-813891e23f1e),volume_type_id=a3711420-4b50-4670-aefd-813891e23f1e)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Creating volume 5474441e-039d-4577-8e12-82a9cd5fef92 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:50:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47a2ac6-1887-4e8f-a0e2-6a29c3dd4fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:42 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 1073741824
Jun 16 18:50:42 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642b8ff-998e-41a1-ae4b-4751dad9c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Volume volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 (6c4b473a-229a-4577-9cb9-13b9ae5b98a0): created successfully
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642b8ff-998e-41a1-ae4b-4751dad9c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Flow 'volume_create_manager' (e3d3c79d-1508-4164-b754-78ebd36318e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6ee631ca-1eda-4234-bf66-454d125960ea tempest-TestInstancesWithCinderVolumes-511283188 None] Created volume successfully.
Jun 16 18:50:42 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.688s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:50:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:50:43 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 1073741824" returned: 0 in 0.928s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:43 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92
Jun 16 18:50:43 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:43 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92" returned: 0 in 0.638s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b85fd0-46c7-4b58-a79b-b53296e54451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5474441e-039d-4577-8e12-82a9cd5fef92', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f27163-22bb-408e-8bd2-76895b28d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:43 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Volume volume-5474441e-039d-4577-8e12-82a9cd5fef92 (5474441e-039d-4577-8e12-82a9cd5fef92): created successfully
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f27163-22bb-408e-8bd2-76895b28d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Flow 'volume_create_manager' (21ea9566-1e42-4905-a7bb-5d42f4e93b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-df62e551-2d71-41de-8c89-d836f99375fa tempest-TestInstancesWithCinderVolumes-511283188 None] Created volume successfully.
Jun 16 18:50:45 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD, size 20.69 MB, duration 3.60 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:50:45 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Image download 20.69 MB at 5.74 MB/s
Jun 16 18:50:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[87781de7-1c05-4cc5-91e2-4c911a657cd3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:45 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD
Jun 16 18:50:45 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:46 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD" returned: 0 in 0.686s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Temporary image 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 is fetched for user 2b5a91309ee9448d816461e6e2442d10. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51403c7-1c31-4793-87bf-075ec30d20f0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:46 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD
Jun 16 18:50:46 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:46 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD" returned: 0 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1019385382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db354e74-403c-40f9-b71b-d8aea569337a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def2b2feabe413dba2554a0d86d6900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:50:41Z,use_quota=True,user_id='2b5a91309ee9448d816461e6e2442d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36412be5-9ba0-468a-952c-d7ec543bb1d1),volume_type_id=36412be5-9ba0-468a-952c-d7ec543bb1d1)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Creating volume db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:50:46 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:50:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:46 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a 1073741824
Jun 16 18:50:46 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:47 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a 1073741824" returned: 0 in 0.846s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:47 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:50:47 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:48 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:50:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:50:48 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Attempting download of 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'metadata': {}}])) to volume db354e74-403c-40f9-b71b-d8aea569337a. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:50:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[c038bed0-6298-45df-8e74-3af21d4db015]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:48 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco
Jun 16 18:50:48 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:49 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:49 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco
Jun 16 18:50:49 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:49 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco" returned: 1 in 0.701s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_xdsiwbco' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:50:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[08448989-cc49-477b-9b8b-a067fff48ec6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:50 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD
Jun 16 18:50:50 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:50 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD" returned: 0 in 0.665s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:50 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 was qcow2, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:50:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:50 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:50:50 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:52 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 0 in 1.903s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:52 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_013968f5-e7d5-4f2c-96ef-ed14a976f8b7_6n0_7642devstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:50:52 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Converted 112.00 MB image at 58.81 MB/s
Jun 16 18:50:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:52 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a 1G
Jun 16 18:50:52 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:53 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a 1G" returned: 0 in 0.679s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:53 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fcc372-804d-4c82-9256-0f3968cee915]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:50:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:53 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:50:53 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:53 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:50:54 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:50:54 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:50:54 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 1 in 0.734s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Downloaded image 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'metadata': {}}])) to volume db354e74-403c-40f9-b71b-d8aea569337a successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Temporary image 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 for user 2b5a91309ee9448d816461e6e2442d10 is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Marking volume db354e74-403c-40f9-b71b-d8aea569337a as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Copying metadata from image 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 to db354e74-403c-40f9-b71b-d8aea569337a. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Creating volume glance metadata for volume db354e74-403c-40f9-b71b-d8aea569337a backed by image 013968f5-e7d5-4f2c-96ef-ed14a976f8b7 with: {'image_id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'image_name': 'tempest-scenario-img--2134196392', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da4420f-9b00-4904-98ac-eb6489dcdeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db354e74-403c-40f9-b71b-d8aea569337a', 'volume_size': 1, 'image_id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2134196392', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8def2b2feabe413dba2554a0d86d6900', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '013968f5-e7d5-4f2c-96ef-ed14a976f8b7', 'created_at': datetime.datetime(2026, 6, 16, 16, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/013968f5-e7d5-4f2c-96ef-ed14a976f8b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b696f30>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46888723-288c-44f7-abb3-1a12b42ba47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:50:54 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Volume volume-db354e74-403c-40f9-b71b-d8aea569337a (db354e74-403c-40f9-b71b-d8aea569337a): created successfully
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46888723-288c-44f7-abb3-1a12b42ba47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:50:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Flow 'volume_create_manager' (a78c09a9-d115-495b-857a-1537c2f69751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:50:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2d31bbd3-f818-4f17-83ed-0663efc5dfd3 tempest-TestInstancesWithCinderVolumes-511283188 None] Created volume successfully.
Jun 16 18:51:02 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=70,cinder:INSERT=25,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:51:02 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=79,cinder:INSERT=26,cinder:UPDATE=74,cinder:DELETE=6 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:51:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5012f-986a-4e69-87e7-dbabe55a51b7]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:02 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:51:02 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:03 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 0 in 0.814s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:03 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:51:03 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:04 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 1 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:51:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.601s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-db354e74-403c-40f9-b71b-d8aea569337a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae402784-9556-4a7e-9fa1-291c4e63d0db', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:51:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-8388db13-d922-4f98-aac7-cff5e5d8d6a4 req-728b07ec-b850-4a19-ba79-821eb17b2602 tempest-TestInstancesWithCinderVolumes-511283188 None] attachment_update completed successfully.
Jun 16 18:51:14 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:51:14 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (e9dc05ee-b9c7-4e7d-9f45-a0890630606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004463f6-ad03-447c-ab6e-412e15f3693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004463f6-ad03-447c-ab6e-412e15f3693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108499916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6d3e82-d170-44df-a15e-92871e302d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:28Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e7e48-2fe5-4b42-98b9-a5efb81cd1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e7e48-2fe5-4b42-98b9-a5efb81cd1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83da51b-9516-46e9-82f9-686ed6465e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83da51b-9516-46e9-82f9-686ed6465e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6d3e82-d170-44df-a15e-92871e302d5d', 'volume_name': 'volume-cd6d3e82-d170-44df-a15e-92871e302d5d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44da20b5-16db-4fe8-b153-bd2ed74a6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44da20b5-16db-4fe8-b153-bd2ed74a6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412c45cc-ec40-4e64-b74a-b5e2eacf858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:28 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Volume cd6d3e82-d170-44df-a15e-92871e302d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6d3e82-d170-44df-a15e-92871e302d5d', 'volume_size': 1}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108499916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6d3e82-d170-44df-a15e-92871e302d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:28Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Creating volume cd6d3e82-d170-44df-a15e-92871e302d5d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:51:28 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:28 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d 1073741824
Jun 16 18:51:28 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:28 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d 1073741824" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:28 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d
Jun 16 18:51:28 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:29 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412c45cc-ec40-4e64-b74a-b5e2eacf858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6d3e82-d170-44df-a15e-92871e302d5d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb64939-2bce-4139-af15-8930ea15bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:29 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Volume volume-cd6d3e82-d170-44df-a15e-92871e302d5d (cd6d3e82-d170-44df-a15e-92871e302d5d): created successfully
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb64939-2bce-4139-af15-8930ea15bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (e9dc05ee-b9c7-4e7d-9f45-a0890630606c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5b660ca2-8f14-4feb-b009-268b597304c6 tempest-VolumesActionsTest-1129473912 None] Created volume successfully.
Jun 16 18:51:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-355b5869-8679-4f6b-9122-57481bb2273d tempest-VolumesActionsTest-1129473912 None] Acquiring lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d" by "attach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-355b5869-8679-4f6b-9122-57481bb2273d tempest-VolumesActionsTest-1129473912 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d" acquired by "attach_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-355b5869-8679-4f6b-9122-57481bb2273d tempest-VolumesActionsTest-1129473912 None] Attaching volume cd6d3e82-d170-44df-a15e-92871e302d5d to instance 765eaa26-9f8c-4937-bf18-5807c6ace3e0 at mountpoint /dev/vdb on host None.
Jun 16 18:51:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-355b5869-8679-4f6b-9122-57481bb2273d tempest-VolumesActionsTest-1129473912 None] Attach volume completed successfully.
Jun 16 18:51:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-355b5869-8679-4f6b-9122-57481bb2273d tempest-VolumesActionsTest-1129473912 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d" released by "attach_volume" :: held 0.080s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-243a9c19-4193-4f33-9792-0ff7a53d308e tempest-VolumesActionsTest-1513028290 None] Terminate volume connection completed successfully.
Jun 16 18:51:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-243a9c19-4193-4f33-9792-0ff7a53d308e tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-detach_volume" by "detach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-243a9c19-4193-4f33-9792-0ff7a53d308e tempest-VolumesActionsTest-1513028290 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-243a9c19-4193-4f33-9792-0ff7a53d308e tempest-VolumesActionsTest-1513028290 None] Detaching volume cd6d3e82-d170-44df-a15e-92871e302d5d from instance 765eaa26-9f8c-4937-bf18-5807c6ace3e0.
Jun 16 18:51:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-243a9c19-4193-4f33-9792-0ff7a53d308e tempest-VolumesActionsTest-1513028290 None] Detach volume completed successfully.
Jun 16 18:51:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-243a9c19-4193-4f33-9792-0ff7a53d308e tempest-VolumesActionsTest-1513028290 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0d1ea5e4-16c4-4727-8493-76eb047076cb tempest-VolumesActionsTest-1129473912 None] Acquiring lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-detach_volume" by "detach_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0d1ea5e4-16c4-4727-8493-76eb047076cb tempest-VolumesActionsTest-1129473912 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:32 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-0d1ea5e4-16c4-4727-8493-76eb047076cb tempest-VolumesActionsTest-1129473912 None] Volume detach called, but volume not attached.
Jun 16 18:51:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-0d1ea5e4-16c4-4727-8493-76eb047076cb tempest-VolumesActionsTest-1129473912 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Acquiring lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Acquiring lock "cinder-quobyte-cd6d3e82-d170-44df-a15e-92871e302d5d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Lock "cinder-quobyte-cd6d3e82-d170-44df-a15e-92871e302d5d" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f27bb5-d6a3-42e0-8558-a86d377f68fd]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:33 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d
Jun 16 18:51:33 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:34 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d" returned: 0 in 0.786s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:34 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d
Jun 16 18:51:34 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:34 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd6d3e82-d170-44df-a15e-92871e302d5d" returned: 0 in 0.625s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Lock "cinder-quobyte-cd6d3e82-d170-44df-a15e-92871e302d5d" released by "delete_volume" :: held 1.471s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Created reservations ['7e9eeec2-75a1-485d-9a9e-1299610575d3', '415f5b5c-4933-492e-9e33-d89fd89860da', '295f2722-0240-444a-96dc-512d4bd681ca', '0637fe19-8e2b-4edf-b757-a6108895a918'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:34 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:51:34 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:35 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.646s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:35 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:51:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Deleted volume successfully.
Jun 16 18:51:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-44728726-b9fc-4ab8-84e0-d94e19dfb8db tempest-VolumesActionsTest-1129473912 None] Lock "cinder-cd6d3e82-d170-44df-a15e-92871e302d5d-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:42 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:51:42 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (fdf0eaa6-f49e-4ef0-99df-ecc5285f8cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be92dd1a-571b-4511-a077-f5b6ec51356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be92dd1a-571b-4511-a077-f5b6ec51356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1052990920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c53c8c-8f33-45d9-8e36-0c78d68881ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:42Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62713d88-dc96-4206-b0d3-3bd99b566696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62713d88-dc96-4206-b0d3-3bd99b566696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e162be2-d0d6-4704-bd51-8b9ffdf44bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e162be2-d0d6-4704-bd51-8b9ffdf44bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c53c8c-8f33-45d9-8e36-0c78d68881ce', 'volume_name': 'volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad382a3c-75a0-44fd-add8-1194f74d95f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad382a3c-75a0-44fd-add8-1194f74d95f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a0a293-e792-4944-8336-040d67e36b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Volume c9c53c8c-8f33-45d9-8e36-0c78d68881ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce', 'volume_size': 1}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1052990920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c53c8c-8f33-45d9-8e36-0c78d68881ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:42Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Creating volume c9c53c8c-8f33-45d9-8e36-0c78d68881ce {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:51:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:42 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce 1073741824
Jun 16 18:51:42 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:42 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.623s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:51:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:43 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce 1073741824" returned: 0 in 0.799s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:43 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce
Jun 16 18:51:43 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:43 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce" returned: 0 in 0.570s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.881s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a0a293-e792-4944-8336-040d67e36b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1db40ee-6ab2-4968-a198-33013d90aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043beec-b201-4fd9-a732-2b0d06efc22b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:43 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Volume volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce (c9c53c8c-8f33-45d9-8e36-0c78d68881ce): created successfully
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1db40ee-6ab2-4968-a198-33013d90aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (fdf0eaa6-f49e-4ef0-99df-ecc5285f8cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f9b00192-8fe3-49b2-b490-25cf3058cf9b tempest-VolumesActionsTest-1129473912 None] Created volume successfully.
Jun 16 18:51:43 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0
Jun 16 18:51:43 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:44 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-c9c53c8c-8f33-45d9-8e36-0c78d68881ce-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" returned: 0 in 0.708s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Lock "cinder-c9c53c8c-8f33-45d9-8e36-0c78d68881ce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd17f7ac4-292c-4ea4-b8b6-eb25b2f83d4b', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-quobyte-c9c53c8c-8f33-45d9-8e36-0c78d68881ce" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-c9c53c8c-8f33-45d9-8e36-0c78d68881ce" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2cd803-2e61-4323-a49d-7e54c6bbaff5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:44 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-75bbc43e-ebbd-4f1b-90c8-fe8ef276ca5c req-0c5dda78-61af-4b89-bdb7-17ea39a84b84 tempest-TestInstancesWithCinderVolumes-511283188 None] attachment_update completed successfully.
Jun 16 18:51:44 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce
Jun 16 18:51:44 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:45 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce" returned: 0 in 0.681s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:45 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce
Jun 16 18:51:45 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:45 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9c53c8c-8f33-45d9-8e36-0c78d68881ce" returned: 0 in 0.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-c9c53c8c-8f33-45d9-8e36-0c78d68881ce" released by "delete_volume" :: held 1.343s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Created reservations ['013ca114-2fb8-4004-ac94-b097030c7297', '6ca89cfe-8533-47ef-abfb-a76842965199', 'ea24535f-986a-47f5-abb3-d1cb41052838', '2503a8a0-3fd2-41b4-b5c1-f5a39823c57d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:45 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:51:45 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:46 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.592s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:46 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:51:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Deleted volume successfully.
Jun 16 18:51:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d0332030-49ca-488b-8b7b-726ca62b04fc tempest-VolumesActionsTest-1513028290 None] Lock "cinder-c9c53c8c-8f33-45d9-8e36-0c78d68881ce-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:46 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (a53d76d2-4061-4553-bdef-b77d9afc4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527e8290-972f-4af3-9391-3ab2a99c8b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527e8290-972f-4af3-9391-3ab2a99c8b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1472398112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18af6281-684b-41c9-940a-5c43367de693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:47Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b577fe-21ad-49bf-87b0-5e96448a57d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b577fe-21ad-49bf-87b0-5e96448a57d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3d9529-423d-47b1-bffc-cb373e4b7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3d9529-423d-47b1-bffc-cb373e4b7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18af6281-684b-41c9-940a-5c43367de693', 'volume_name': 'volume-18af6281-684b-41c9-940a-5c43367de693', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c2b44-ce18-425c-b724-d6981004179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c2b44-ce18-425c-b724-d6981004179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bac0cfd-8b85-4e53-8790-af7a13146172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:47 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Volume 18af6281-684b-41c9-940a-5c43367de693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18af6281-684b-41c9-940a-5c43367de693', 'volume_size': 1}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1472398112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18af6281-684b-41c9-940a-5c43367de693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:47Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Creating volume 18af6281-684b-41c9-940a-5c43367de693 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:51:47 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:47 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693 1073741824
Jun 16 18:51:47 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:47 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693 1073741824" returned: 0 in 0.749s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:47 devstack sudo[107323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693
Jun 16 18:51:47 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:48 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693" returned: 0 in 0.569s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bac0cfd-8b85-4e53-8790-af7a13146172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18af6281-684b-41c9-940a-5c43367de693', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a91847-dc16-4bf1-8aa6-f744be74ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Volume volume-18af6281-684b-41c9-940a-5c43367de693 (18af6281-684b-41c9-940a-5c43367de693): created successfully
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a91847-dc16-4bf1-8aa6-f744be74ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (a53d76d2-4061-4553-bdef-b77d9afc4e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-c76c5ee7-8f47-4842-a00c-ad17002c3f34 tempest-VolumesActionsTest-1129473912 None] Created volume successfully.
Jun 16 18:51:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-18af6281-684b-41c9-940a-5c43367de693-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Lock "cinder-18af6281-684b-41c9-940a-5c43367de693-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-quobyte-18af6281-684b-41c9-940a-5c43367de693" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-18af6281-684b-41c9-940a-5c43367de693" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a33a7-7933-4778-99a2-d2a70d724a60]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:49 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693
Jun 16 18:51:49 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:50 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693" returned: 0 in 0.717s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:50 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693
Jun 16 18:51:50 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:50 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-18af6281-684b-41c9-940a-5c43367de693" returned: 0 in 0.577s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-18af6281-684b-41c9-940a-5c43367de693" released by "delete_volume" :: held 1.333s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Created reservations ['5b396ec1-f8b4-4483-941e-8e95cd815370', '55e7a6de-88bc-4d45-8150-7cc6745f54a6', '881136e2-cf33-47ce-93a2-dbb01bf5ddeb', '1aa100eb-ac82-4573-8ef1-acc86b40da28'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:50 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:51:50 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:51 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.592s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:51:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Deleted volume successfully.
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f9983e8-8ea6-418a-b807-bd67d89c506e tempest-VolumesActionsTest-1513028290 None] Lock "cinder-18af6281-684b-41c9-940a-5c43367de693-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (a6c8c38d-5452-4330-a649-5da7bf52e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4683eaee-07b1-4c0f-89d5-3e5db51268d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4683eaee-07b1-4c0f-89d5-3e5db51268d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-635547043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c82f06-d5e4-4f10-91ce-da24f61a6cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:52Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6263fae6-d4c8-403c-a919-c6d5cd41c5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6263fae6-d4c8-403c-a919-c6d5cd41c5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2910a004-55bf-4702-a664-5f32d7efba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2910a004-55bf-4702-a664-5f32d7efba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c82f06-d5e4-4f10-91ce-da24f61a6cd6', 'volume_name': 'volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4d3007-2121-4894-9e80-c42ea6d28b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4d3007-2121-4894-9e80-c42ea6d28b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e393c9-ec19-43a8-96a5-72628394d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:51 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Volume 10c82f06-d5e4-4f10-91ce-da24f61a6cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6', 'volume_size': 1}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-635547043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c82f06-d5e4-4f10-91ce-da24f61a6cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:52Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Creating volume 10c82f06-d5e4-4f10-91ce-da24f61a6cd6 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:51:51 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:51:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:52 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 1073741824
Jun 16 18:51:52 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:52 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 1073741824" returned: 0 in 0.786s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:52 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6
Jun 16 18:51:52 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:53 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6" returned: 0 in 0.604s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.203s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e393c9-ec19-43a8-96a5-72628394d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15c607-2bc1-4ca5-a36d-ae9b2810a979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a90ca13-2b44-45dc-8c1a-48206d0de52f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:53 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Volume volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 (10c82f06-d5e4-4f10-91ce-da24f61a6cd6): created successfully
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15c607-2bc1-4ca5-a36d-ae9b2810a979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (a6c8c38d-5452-4330-a649-5da7bf52e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-eca55eb2-77f9-40f6-ad1e-891167d215a9 tempest-VolumesActionsTest-1129473912 None] Created volume successfully.
Jun 16 18:51:53 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92
Jun 16 18:51:53 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:54 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.738s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-10c82f06-d5e4-4f10-91ce-da24f61a6cd6-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-5474441e-039d-4577-8e12-82a9cd5fef92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce371f88-ad49-467a-ad2d-71a47bf7b91d', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Lock "cinder-10c82f06-d5e4-4f10-91ce-da24f61a6cd6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-quobyte-10c82f06-d5e4-4f10-91ce-da24f61a6cd6" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-10c82f06-d5e4-4f10-91ce-da24f61a6cd6" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-67766996-7e02-483d-b160-819fc2b4baad req-7dc13cc5-0dd6-4db9-8fdd-96213fd1ec54 tempest-TestInstancesWithCinderVolumes-511283188 None] attachment_update completed successfully.
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2ffc3f-31dc-4603-aa76-1febd3e7a39d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:54 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6
Jun 16 18:51:54 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:55 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6" returned: 0 in 0.709s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:55 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6
Jun 16 18:51:55 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:55 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-10c82f06-d5e4-4f10-91ce-da24f61a6cd6" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-10c82f06-d5e4-4f10-91ce-da24f61a6cd6" released by "delete_volume" :: held 1.361s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Created reservations ['b4c52d3c-e88f-4b52-a893-7b35f6a546f8', '55da4533-6143-409a-b4e2-5c4c22d89473', '512d4e2c-0a3a-454c-b107-f66893c83226', '850a780c-c10f-4fee-9c33-4b1270fa31a6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:55 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:51:55 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:56 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:51:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Deleted volume successfully.
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f779fa37-8975-43bb-852a-22af2cfd7ebd tempest-VolumesActionsTest-1513028290 None] Lock "cinder-10c82f06-d5e4-4f10-91ce-da24f61a6cd6-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (7a6967b3-efba-485b-91c4-b8f6096c4482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456fac02-2c5f-43f8-90a4-f6e10cd42339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456fac02-2c5f-43f8-90a4-f6e10cd42339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463621175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f1787f-abbd-4c56-9c69-06146f0cac58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:57Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fbe89a-e250-4085-b574-ca904631c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fbe89a-e250-4085-b574-ca904631c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2f0718-a660-4a94-acf8-bec718256220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2f0718-a660-4a94-acf8-bec718256220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f1787f-abbd-4c56-9c69-06146f0cac58', 'volume_name': 'volume-d5f1787f-abbd-4c56-9c69-06146f0cac58', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc7944-2138-4710-8bb8-59fc0bb7614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc7944-2138-4710-8bb8-59fc0bb7614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a31dbe-d8fc-4229-b76e-d26fc2dbf714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Volume d5f1787f-abbd-4c56-9c69-06146f0cac58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f1787f-abbd-4c56-9c69-06146f0cac58', 'volume_size': 1}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463621175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f1787f-abbd-4c56-9c69-06146f0cac58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:51:57Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Creating volume d5f1787f-abbd-4c56-9c69-06146f0cac58 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:51:56 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:51:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:56 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 1073741824
Jun 16 18:51:56 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:57 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 1073741824" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:57 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58
Jun 16 18:51:57 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:58 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a31dbe-d8fc-4229-b76e-d26fc2dbf714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f1787f-abbd-4c56-9c69-06146f0cac58', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0442adfc-2dab-47ac-be54-ace03853dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:51:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Volume volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 (d5f1787f-abbd-4c56-9c69-06146f0cac58): created successfully
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0442adfc-2dab-47ac-be54-ace03853dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:51:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (7a6967b3-efba-485b-91c4-b8f6096c4482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:51:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-caf0b18a-4250-42a3-94f7-9aef43606c7f tempest-VolumesActionsTest-1129473912 None] Created volume successfully.
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-d5f1787f-abbd-4c56-9c69-06146f0cac58-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Lock "cinder-d5f1787f-abbd-4c56-9c69-06146f0cac58-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Acquiring lock "cinder-quobyte-d5f1787f-abbd-4c56-9c69-06146f0cac58" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-d5f1787f-abbd-4c56-9c69-06146f0cac58" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a8f3e-0ab7-4b90-b41c-244c558b8e63]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:59 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58
Jun 16 18:51:59 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:51:59 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58" returned: 0 in 0.757s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:51:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:51:59 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58
Jun 16 18:51:59 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:00 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d5f1787f-abbd-4c56-9c69-06146f0cac58" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Lock "cinder-quobyte-d5f1787f-abbd-4c56-9c69-06146f0cac58" released by "delete_volume" :: held 1.406s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Created reservations ['0638f5c7-0611-421c-a593-f7cfe089a3a2', '9a4a507d-2e44-4624-94c6-1afd29f1f7bd', '576e41c3-269b-4f28-a3e0-290bc2ea11cb', '9cad7a8b-668b-49e0-97e1-db6f74ca5ee6'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:00 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:00 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:01 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.604s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Deleted volume successfully.
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9738296b-2177-4059-8633-0defe330f7e6 tempest-VolumesActionsTest-1513028290 None] Lock "cinder-d5f1787f-abbd-4c56-9c69-06146f0cac58-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (7d6ccf77-8029-4043-9293-a66a1b4c6af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c174421-3c7a-4448-b3a8-521e71c4969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c174421-3c7a-4448-b3a8-521e71c4969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1856698033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f594e75c-3256-44b5-8ce5-b0ad3725f486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:02Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22b8272-5e12-44cb-9973-711f68edf07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22b8272-5e12-44cb-9973-711f68edf07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ab5ff-24b2-4375-b515-687fad108173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ab5ff-24b2-4375-b515-687fad108173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f594e75c-3256-44b5-8ce5-b0ad3725f486', 'volume_name': 'volume-f594e75c-3256-44b5-8ce5-b0ad3725f486', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362bc18c-6888-4276-869f-2f1a3263cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362bc18c-6888-4276-869f-2f1a3263cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42210c71-f369-4e87-84d9-1f138c12770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:01 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Volume f594e75c-3256-44b5-8ce5-b0ad3725f486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f594e75c-3256-44b5-8ce5-b0ad3725f486', 'volume_size': 1}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1856698033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f594e75c-3256-44b5-8ce5-b0ad3725f486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc1605733e4c6da1c34082b4f9416b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:02Z,use_quota=True,user_id='f2ac3b35cdde49f7af82d1670b53f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Creating volume f594e75c-3256-44b5-8ce5-b0ad3725f486 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:01 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:01 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 1073741824
Jun 16 18:52:01 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:02 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 1073741824" returned: 0 in 0.764s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:02 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486
Jun 16 18:52:02 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:02 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-3e07f00e-0ca9-45b5-aaa2-77abd4b09bb6 req-5653b4f2-08f0-4f59-a987-79e17da5a527 tempest-TestInstancesWithCinderVolumes-511283188 None] Terminate volume connection completed successfully.
Jun 16 18:52:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-3e07f00e-0ca9-45b5-aaa2-77abd4b09bb6 req-5653b4f2-08f0-4f59-a987-79e17da5a527 tempest-TestInstancesWithCinderVolumes-511283188 None] Deleting attachment d17f7ac4-292c-4ea4-b8b6-eb25b2f83d4b. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:52:03 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486" returned: 0 in 0.615s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42210c71-f369-4e87-84d9-1f138c12770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f594e75c-3256-44b5-8ce5-b0ad3725f486', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c28ad84-85b7-4a40-af20-6b9bbe4bd417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:03 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Volume volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 (f594e75c-3256-44b5-8ce5-b0ad3725f486): created successfully
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c28ad84-85b7-4a40-af20-6b9bbe4bd417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Flow 'volume_create_manager' (7d6ccf77-8029-4043-9293-a66a1b4c6af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-813d8658-b80c-470b-80b2-8751a68151d2 tempest-VolumesActionsTest-1129473912 None] Created volume successfully.
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Acquiring lock "cinder-f594e75c-3256-44b5-8ce5-b0ad3725f486-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Lock "cinder-f594e75c-3256-44b5-8ce5-b0ad3725f486-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Acquiring lock "cinder-quobyte-f594e75c-3256-44b5-8ce5-b0ad3725f486" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Lock "cinder-quobyte-f594e75c-3256-44b5-8ce5-b0ad3725f486" acquired by "delete_volume" :: waited 0.012s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b5cdf-d269-42c9-b5e0-edd254ff66e3]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:04 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486
Jun 16 18:52:04 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "cinder-6c4b473a-229a-4577-9cb9-13b9ae5b98a0-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-6c4b473a-229a-4577-9cb9-13b9ae5b98a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "cinder-quobyte-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-quobyte-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abf14d4-4ce7-4b54-b9ca-e841ba29e702]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:05 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0
Jun 16 18:52:05 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:05 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486" returned: 0 in 0.713s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:05 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486
Jun 16 18:52:05 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:05 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:05 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0
Jun 16 18:52:05 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:05 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f594e75c-3256-44b5-8ce5-b0ad3725f486" returned: 0 in 0.662s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Lock "cinder-quobyte-f594e75c-3256-44b5-8ce5-b0ad3725f486" released by "delete_volume" :: held 1.419s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Created reservations ['56ea58a4-bc22-4a41-ba0e-171b69181983', '1dc10df2-47ce-47e1-91a6-5bd8f4426ac6', '8ecdbecb-645f-4bfb-a892-085abb26cf7b', '087c8a66-378f-4df6-99cb-63e2fc82dee3'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:06 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:06 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:06 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" returned: 0 in 0.632s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-quobyte-6c4b473a-229a-4577-9cb9-13b9ae5b98a0" released by "delete_volume" :: held 1.440s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:06 devstack cinder-volume[91851]: WARNING cinder.quota [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-850609031-1943300593 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-850609031-1943300593, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:52:06 devstack cinder-volume[91851]: WARNING cinder.quota [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-850609031-1943300593 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-850609031-1943300593, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Created reservations ['9a8500c7-702f-406f-bdb9-be860605fbb1', '229a83e1-36b8-4a47-86b5-2d9d2ff98c22', '374cf80b-1441-49cb-b3c3-abc38b2753c4', '4cc6fbf7-3740-443e-9fb8-bef9bee266a1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:06 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:06 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:06 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.702s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:06 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Deleted volume successfully.
Jun 16 18:52:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5a2aab67-455c-465d-8e4a-f252c946ccfa tempest-VolumesActionsTest-1129473912 None] Lock "cinder-f594e75c-3256-44b5-8ce5-b0ad3725f486-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:07 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.692s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:07 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:07 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Deleted volume successfully.
Jun 16 18:52:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2b0847ac-cfc8-4b5f-b791-ecb3241acfd1 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-6c4b473a-229a-4577-9cb9-13b9ae5b98a0-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:09 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-65f3f048-77c8-4a36-aa85-7ffc2f237cb2 req-98e7e06f-ff61-43d2-a1d2-cd9c73f07de3 tempest-TestInstancesWithCinderVolumes-511283188 None] Terminate volume connection completed successfully.
Jun 16 18:52:09 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-65f3f048-77c8-4a36-aa85-7ffc2f237cb2 req-98e7e06f-ff61-43d2-a1d2-cd9c73f07de3 tempest-TestInstancesWithCinderVolumes-511283188 None] Deleting attachment ce371f88-ad49-467a-ad2d-71a47bf7b91d. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:52:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "cinder-5474441e-039d-4577-8e12-82a9cd5fef92-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-5474441e-039d-4577-8e12-82a9cd5fef92-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "cinder-quobyte-5474441e-039d-4577-8e12-82a9cd5fef92" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-quobyte-5474441e-039d-4577-8e12-82a9cd5fef92" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6255ea5-2808-433d-9f91-72ecdcd18bda]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:11 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92
Jun 16 18:52:11 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:12 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92" returned: 0 in 0.823s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:12 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92
Jun 16 18:52:12 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:12 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5474441e-039d-4577-8e12-82a9cd5fef92" returned: 0 in 0.748s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-quobyte-5474441e-039d-4577-8e12-82a9cd5fef92" released by "delete_volume" :: held 1.622s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:13 devstack cinder-volume[91851]: WARNING cinder.quota [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015482265-1756174348 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015482265-1756174348, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:52:13 devstack cinder-volume[91851]: WARNING cinder.quota [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015482265-1756174348 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015482265-1756174348, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Created reservations ['3dc1d7af-6401-4f3b-825d-cca967bf867b', '23642d47-9a54-4cca-a61b-eb9d59a71e96', 'a497b379-7bd5-456b-b7fd-be93432da779', '23379ba5-c3e3-49ef-9d7b-9751ea1a25c2'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:13 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:13 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:13 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.831s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:13 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:13 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Deleted volume successfully.
Jun 16 18:52:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8482205c-1074-4811-9243-014924177329 tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-5474441e-039d-4577-8e12-82a9cd5fef92-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-84b9c4a1-5150-469d-a4a8-8fda8528eb85 req-84218449-b5df-411a-9035-c2c63f197165 tempest-TestInstancesWithCinderVolumes-511283188 None] Terminate volume connection completed successfully.
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-84b9c4a1-5150-469d-a4a8-8fda8528eb85 req-84218449-b5df-411a-9035-c2c63f197165 tempest-TestInstancesWithCinderVolumes-511283188 None] Deleting attachment ae402784-9556-4a7e-9fa1-291c4e63d0db. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Flow 'volume_create_manager' (b6efd253-76a6-4940-9849-bc3ac9f7994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0ea4cf-30c3-4264-8600-b2db0dcd56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0ea4cf-30c3-4264-8600-b2db0dcd56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-610335418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9b58b4-8476-49fd-bfa6-f4d882ad30ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c83abd6a8e84497af96a10d0a02bb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:18Z,use_quota=True,user_id='4602a0e8a3c844f5844e68da8c741c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9039506-1014-465c-85ef-0823fc81e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9039506-1014-465c-85ef-0823fc81e115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717fdf87-d55a-4698-bbd6-e65065b678e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717fdf87-d55a-4698-bbd6-e65065b678e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9b58b4-8476-49fd-bfa6-f4d882ad30ab', 'volume_name': 'volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53defba-47ad-44cb-8540-8dec3519a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53defba-47ad-44cb-8540-8dec3519a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20714b7-c209-441b-94ee-de0a0718afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Volume ed9b58b4-8476-49fd-bfa6-f4d882ad30ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab', 'volume_size': 1}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-610335418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9b58b4-8476-49fd-bfa6-f4d882ad30ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c83abd6a8e84497af96a10d0a02bb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:18Z,use_quota=True,user_id='4602a0e8a3c844f5844e68da8c741c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Creating volume ed9b58b4-8476-49fd-bfa6-f4d882ad30ab {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:18 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:18 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab 1073741824
Jun 16 18:52:18 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:19 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab 1073741824" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:19 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab
Jun 16 18:52:19 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:19 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab" returned: 0 in 0.607s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20714b7-c209-441b-94ee-de0a0718afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e21ff6-9e7f-4c23-8bcc-8c0fe4a66d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Volume volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab (ed9b58b4-8476-49fd-bfa6-f4d882ad30ab): created successfully
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e21ff6-9e7f-4c23-8bcc-8c0fe4a66d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Flow 'volume_create_manager' (b6efd253-76a6-4940-9849-bc3ac9f7994a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-42e2b78f-5abf-4810-8cb0-3d6259d3a492 tempest-VolumesListAdminTestJSON-1400567492 None] Created volume successfully.
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Flow 'volume_create_manager' (b7586c9d-c721-4951-a766-a590898ac730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9c3241-f803-404e-be39-a29345840101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9c3241-f803-404e-be39-a29345840101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-814703322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c83abd6a8e84497af96a10d0a02bb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:21Z,use_quota=True,user_id='4602a0e8a3c844f5844e68da8c741c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d6f51-ab92-408a-a832-b4f04569cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d6f51-ab92-408a-a832-b4f04569cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff32ad06-5c3d-49b9-89cf-68c7f681c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff32ad06-5c3d-49b9-89cf-68c7f681c068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91', 'volume_name': 'volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa19704-3d65-4cf3-a104-6582d75e3560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa19704-3d65-4cf3-a104-6582d75e3560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9172097f-cf23-4de9-a283-60dfcbbe8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:20 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Volume 925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91', 'volume_size': 1}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-814703322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c83abd6a8e84497af96a10d0a02bb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:21Z,use_quota=True,user_id='4602a0e8a3c844f5844e68da8c741c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Creating volume 925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:20 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:21 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 1073741824
Jun 16 18:52:21 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "cinder-db354e74-403c-40f9-b71b-d8aea569337a-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-db354e74-403c-40f9-b71b-d8aea569337a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "cinder-quobyte-db354e74-403c-40f9-b71b-d8aea569337a" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-quobyte-db354e74-403c-40f9-b71b-d8aea569337a" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[daded7bd-63aa-4e5e-ad7c-eb1cc77a0cc5]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:21 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:52:21 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:21 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 1073741824" returned: 0 in 0.799s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:21 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91
Jun 16 18:52:21 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:22 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 0 in 0.717s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:22 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:52:22 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:22 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9172097f-cf23-4de9-a283-60dfcbbe8b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9673296-4403-4950-bbe7-c1bd0e0ff59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:22 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Volume volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 (925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91): created successfully
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9673296-4403-4950-bbe7-c1bd0e0ff59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Flow 'volume_create_manager' (b7586c9d-c721-4951-a766-a590898ac730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-acb47e7f-0a69-4f26-bf1d-5daf22079a26 tempest-VolumesListAdminTestJSON-1400567492 None] Created volume successfully.
Jun 16 18:52:22 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 1 in 0.680s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:52:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:22 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a
Jun 16 18:52:22 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Flow 'volume_create_manager' (194cd50d-b8bb-47e1-b284-1a563aa56a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29367fc-f1e1-4f48-be05-247763af652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:23 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-db354e74-403c-40f9-b71b-d8aea569337a" returned: 0 in 0.617s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-quobyte-db354e74-403c-40f9-b71b-d8aea569337a" released by "delete_volume" :: held 2.088s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29367fc-f1e1-4f48-be05-247763af652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-980496296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c3d219-c85c-476a-8ffa-e9bacc0737b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c83abd6a8e84497af96a10d0a02bb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:23Z,use_quota=True,user_id='4602a0e8a3c844f5844e68da8c741c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4458f1b-153d-46b8-8962-8c1f4c3eb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4458f1b-153d-46b8-8962-8c1f4c3eb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8e3915-7dab-4274-bba6-6cf64b86e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8e3915-7dab-4274-bba6-6cf64b86e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c3d219-c85c-476a-8ffa-e9bacc0737b2', 'volume_name': 'volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3b596e-ae55-451d-9e23-989573167278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3b596e-ae55-451d-9e23-989573167278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755c31f9-43c7-4682-bb29-29100597cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:23 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Volume 83c3d219-c85c-476a-8ffa-e9bacc0737b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2', 'volume_size': 1}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-980496296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c3d219-c85c-476a-8ffa-e9bacc0737b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c83abd6a8e84497af96a10d0a02bb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:23Z,use_quota=True,user_id='4602a0e8a3c844f5844e68da8c741c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Creating volume 83c3d219-c85c-476a-8ffa-e9bacc0737b2 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:23 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:23 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 1073741824
Jun 16 18:52:23 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:23 devstack cinder-volume[91851]: WARNING cinder.quota [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296399121-1291986308 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296399121-1291986308, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:52:23 devstack cinder-volume[91851]: WARNING cinder.quota [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296399121-1291986308 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-296399121-1291986308, it is now deprecated. Please use the default quota class for default quota.
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Created reservations ['c34672e5-b0d6-4a63-b521-f434c02201d5', '8efa1d86-b25c-459f-aba4-534d5de54f5d', '8c857d1f-de9b-430c-878e-917049165f09', '1a048bb7-059e-441d-a70c-fbd0ec28d861'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:23 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:23 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:24 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.622s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:24 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 1073741824" returned: 0 in 0.751s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:24 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Deleted volume successfully.
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0667d7-a1a8-4517-b172-406018993fca tempest-TestInstancesWithCinderVolumes-511283188 None] Lock "cinder-db354e74-403c-40f9-b71b-d8aea569337a-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:24 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2
Jun 16 18:52:24 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:24 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2" returned: 0 in 0.621s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=117,cinder:SELECT=74,cinder:DELETE=9,cinder:INSERT=27 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755c31f9-43c7-4682-bb29-29100597cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ba86a7-4f82-45c3-80c1-153bf187b785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:24 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=95,cinder:UPDATE=93,cinder:INSERT=20,cinder:DELETE=8 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:52:25 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Volume volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 (83c3d219-c85c-476a-8ffa-e9bacc0737b2): created successfully
Jun 16 18:52:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ba86a7-4f82-45c3-80c1-153bf187b785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Flow 'volume_create_manager' (194cd50d-b8bb-47e1-b284-1a563aa56a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-371114c5-3350-4228-91af-0514c2a17d1a tempest-VolumesListAdminTestJSON-1400567492 None] Created volume successfully.
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Flow 'volume_create_manager' (a454bbc1-5d90-4155-9f72-bca61035c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482cf817-e585-4c85-8d19-85e12e4d9071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482cf817-e585-4c85-8d19-85e12e4d9071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce5c8a8-8246-4786-82e4-764c2d56dea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6063462c7cee460ba577d81ffb585a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:26Z,use_quota=True,user_id='09ed0cd0e51f46bb99a9498f910eb3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c919c61f-c240-4c1a-b8a6-f63399286b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c919c61f-c240-4c1a-b8a6-f63399286b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b4b73f-0081-4e7f-92ad-9d1c1b3c25a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b4b73f-0081-4e7f-92ad-9d1c1b3c25a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce5c8a8-8246-4786-82e4-764c2d56dea0', 'volume_name': 'volume-dce5c8a8-8246-4786-82e4-764c2d56dea0', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eba0e3c-1194-4c8d-b805-416608c31bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eba0e3c-1194-4c8d-b805-416608c31bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7970f7d-5981-455d-ab4d-6fde2252b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:26 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Volume dce5c8a8-8246-4786-82e4-764c2d56dea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce5c8a8-8246-4786-82e4-764c2d56dea0', 'volume_size': 1}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce5c8a8-8246-4786-82e4-764c2d56dea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6063462c7cee460ba577d81ffb585a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:26Z,use_quota=True,user_id='09ed0cd0e51f46bb99a9498f910eb3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Creating volume dce5c8a8-8246-4786-82e4-764c2d56dea0 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:26 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:26 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 1073741824
Jun 16 18:52:26 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:26 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 1073741824" returned: 0 in 0.768s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:27 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0
Jun 16 18:52:27 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:27 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0" returned: 0 in 0.623s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7970f7d-5981-455d-ab4d-6fde2252b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce5c8a8-8246-4786-82e4-764c2d56dea0', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2bf148-4fcf-49c6-906b-ad1d95588c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:27 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Volume volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 (dce5c8a8-8246-4786-82e4-764c2d56dea0): created successfully
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2bf148-4fcf-49c6-906b-ad1d95588c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:27 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Flow 'volume_create_manager' (a454bbc1-5d90-4155-9f72-bca61035c378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7981aafa-080c-49b4-8177-d94706ddb001 tempest-VolumesListAdminTestJSON-1078898155 None] Created volume successfully.
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Acquiring lock "cinder-dce5c8a8-8246-4786-82e4-764c2d56dea0-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "cinder-dce5c8a8-8246-4786-82e4-764c2d56dea0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Acquiring lock "cinder-quobyte-dce5c8a8-8246-4786-82e4-764c2d56dea0" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "cinder-quobyte-dce5c8a8-8246-4786-82e4-764c2d56dea0" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0669d9-b943-4766-868f-75f20f6c9a29]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "cinder-83c3d219-c85c-476a-8ffa-e9bacc0737b2-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-83c3d219-c85c-476a-8ffa-e9bacc0737b2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:28 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0
Jun 16 18:52:28 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "cinder-quobyte-83c3d219-c85c-476a-8ffa-e9bacc0737b2" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-quobyte-83c3d219-c85c-476a-8ffa-e9bacc0737b2" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9d3dc-4dab-4aa5-832f-ddb84fcd9632]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:28 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2
Jun 16 18:52:28 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:29 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0" returned: 0 in 0.781s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:29 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0
Jun 16 18:52:29 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:29 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2" returned: 0 in 0.829s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:29 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2
Jun 16 18:52:29 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:29 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-dce5c8a8-8246-4786-82e4-764c2d56dea0" returned: 0 in 0.726s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "cinder-quobyte-dce5c8a8-8246-4786-82e4-764c2d56dea0" released by "delete_volume" :: held 1.566s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Created reservations ['089a1fc0-cf70-4165-a2c7-c5ecb4ba5bde', '4c31551f-040e-4a88-8173-7eb89b75c556', 'dcca69f5-c203-46d5-9863-f967c9467dd0', 'ca031183-4373-4950-b8c9-d13463885e30'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:30 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:30 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:30 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-83c3d219-c85c-476a-8ffa-e9bacc0737b2" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-quobyte-83c3d219-c85c-476a-8ffa-e9bacc0737b2" released by "delete_volume" :: held 1.596s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Created reservations ['3f086d6e-72e8-4179-8cea-1b1a773b0ca5', '4bd91dcd-17f0-4532-b8d0-0ff1acba863a', '2f6c8ae8-f147-404f-958a-06e8a05d0101', 'd71a0cb9-1875-45e0-9272-c17ca69916f5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:30 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:30 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:30 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.659s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Deleted volume successfully.
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fbd66193-3296-4bbb-a6f0-14a530fc80a1 tempest-VolumesListAdminTestJSON-1078898155 None] Lock "cinder-dce5c8a8-8246-4786-82e4-764c2d56dea0-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "cinder-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "cinder-quobyte-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-quobyte-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff0101c-6eaf-44f6-ab4d-17df5fcd4ccd]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:31 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91
Jun 16 18:52:31 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:31 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.731s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Deleted volume successfully.
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f62e4eb5-b5a3-46aa-accb-abb5a614f40c tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-83c3d219-c85c-476a-8ffa-e9bacc0737b2-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:31 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91" returned: 0 in 0.819s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:31 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91
Jun 16 18:52:31 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:32 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91" returned: 0 in 0.615s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-quobyte-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91" released by "delete_volume" :: held 1.479s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Created reservations ['426ee83e-17c5-4f23-b254-56f165b63e09', '4eb901b0-0c04-4b27-b4bd-fefed93bb669', '89b5824a-bc24-4c7a-8b91-177a5797f0dd', '2517d8b3-9b3d-4238-ae5b-e93ab76b0135'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:32 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:32 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:33 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.603s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Deleted volume successfully.
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6e74a3ea-daf7-4591-8da6-1ee04cbd0348 tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-925daa06-a4c7-48b7-8ca3-8ac2d6ad3b91-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "cinder-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "cinder-quobyte-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-quobyte-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[906aee45-0870-42a6-a001-c0c681d2cf35]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:33 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab
Jun 16 18:52:33 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:34 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab" returned: 0 in 0.752s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:34 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab
Jun 16 18:52:34 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:34 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab" returned: 0 in 0.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-quobyte-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab" released by "delete_volume" :: held 1.394s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Created reservations ['07d78a07-87ef-457e-8b6f-b8e45156f040', 'f917a5d2-d79e-4f76-97f4-162c84cb6c60', '0d43bfe8-5a54-4184-b19c-0b072a90f874', '5cef1e78-e36f-4b30-b2a0-23fcbde0a62c'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:34 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:34 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:35 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:35 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Deleted volume successfully.
Jun 16 18:52:35 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4791b317-32aa-432d-9b0d-e120f73c5e2b tempest-VolumesListAdminTestJSON-1400567492 None] Lock "cinder-ed9b58b4-8476-49fd-bfa6-f4d882ad30ab-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Flow 'volume_create_manager' (47e65586-1855-407d-bf37-1dafd8834309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3132514b-2605-4bd0-b620-7355056f1bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3132514b-2605-4bd0-b620-7355056f1bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-947057635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e21d518-3e73-4bac-94bb-18d3d164b6f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7700cf43fc364454a6c983e09c8a62f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:40Z,use_quota=True,user_id='5772b74bba7e4844a02d5bd53748f01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cf102b-78a8-4752-beec-948b4b14b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cf102b-78a8-4752-beec-948b4b14b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4618ed02-14fa-4797-af53-88a50b1a115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:39 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4618ed02-14fa-4797-af53-88a50b1a115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e21d518-3e73-4bac-94bb-18d3d164b6f0', 'volume_name': 'volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545baa4440>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d29c99-ab8a-4798-974e-1d4efd2dd318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d29c99-ab8a-4798-974e-1d4efd2dd318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b003f65-8592-4084-8dc2-79480620ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:40 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Volume 3e21d518-3e73-4bac-94bb-18d3d164b6f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545baa4440>}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Trying to clone 3e21d518-3e73-4bac-94bb-18d3d164b6f0 from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:52:40 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Image download 20.69 MB at 20.69 MB/s
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9b156c-1ef1-42bf-a60f-349afc5ce162]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:40 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD
Jun 16 18:52:40 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:41 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD" returned: 0 in 0.701s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:41 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d is fetched for user 5772b74bba7e4844a02d5bd53748f01b. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:52:41 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2de37de-32eb-4954-86fa-9a02261f34d4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:41 devstack sudo[107757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD
Jun 16 18:52:41 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:42 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:42 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:42 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD" returned: 0 in 0.738s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-947057635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e21d518-3e73-4bac-94bb-18d3d164b6f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7700cf43fc364454a6c983e09c8a62f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:40Z,use_quota=True,user_id='5772b74bba7e4844a02d5bd53748f01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Creating volume 3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:42 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 1073741824
Jun 16 18:52:42 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:42 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.603s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:52:42 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 1073741824" returned: 0 in 0.819s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:43 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:43 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:43 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Attempting download of 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume 3e21d518-3e73-4bac-94bb-18d3d164b6f0. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01834cd-27e0-4b24-ad07-44119370d15d]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:43 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68
Jun 16 18:52:43 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:44 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68" returned: 0 in 0.788s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:44 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68
Jun 16 18:52:44 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:45 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68" returned: 1 in 0.698s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_n14goe68' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff5845e-0aed-4f0d-aceb-b9620ac90526]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:45 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD
Jun 16 18:52:45 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:45 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d was qcow2, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:52:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:45 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:45 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:47 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 0 in 1.846s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:47 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d_48io06f3devstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:52:47 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Converted 112.00 MB image at 60.62 MB/s
Jun 16 18:52:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:47 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 1G
Jun 16 18:52:47 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:48 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 1G" returned: 0 in 0.660s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f595bc1-6674-471e-970b-b736614b9047]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:48 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:48 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:49 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 0 in 0.718s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:49 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:49 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:49 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 1 in 0.744s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Downloaded image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d ((None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}])) to volume 3e21d518-3e73-4bac-94bb-18d3d164b6f0 successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Temporary image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d for user 5772b74bba7e4844a02d5bd53748f01b is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Marking volume 3e21d518-3e73-4bac-94bb-18d3d164b6f0 as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Copying metadata from image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d to 3e21d518-3e73-4bac-94bb-18d3d164b6f0. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:52:49 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Creating volume glance metadata for volume 3e21d518-3e73-4bac-94bb-18d3d164b6f0 backed by image 9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b003f65-8592-4084-8dc2-79480620ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0', 'volume_size': 1, 'image_id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd8f784e6ecc43aaaebf81d1ce8abedf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d', 'created_at': datetime.datetime(2026, 6, 16, 16, 30, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 30, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e86b4b4-1968-45cc-a6fb-cde6e2f79d6d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545baa4440>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f359534c-1e0c-4a1c-9339-099ea5f37e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:50 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Volume volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 (3e21d518-3e73-4bac-94bb-18d3d164b6f0): created successfully
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f359534c-1e0c-4a1c-9339-099ea5f37e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Flow 'volume_create_manager' (47e65586-1855-407d-bf37-1dafd8834309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-42fca4e3-6d8d-49ef-9274-b09a5bb631e4 tempest-VolumesImageMetadata-832678047 None] Created volume successfully.
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Acquiring lock "cinder-3e21d518-3e73-4bac-94bb-18d3d164b6f0-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Lock "cinder-3e21d518-3e73-4bac-94bb-18d3d164b6f0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Acquiring lock "cinder-quobyte-3e21d518-3e73-4bac-94bb-18d3d164b6f0" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:52:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Lock "cinder-quobyte-3e21d518-3e73-4bac-94bb-18d3d164b6f0" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:52:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db88ae-f847-4f52-9d91-24cfeee93d23]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:51 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:51 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:51 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 0 in 0.802s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:51 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:51 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:52 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 1 in 0.757s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:52:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:52 devstack sudo[107821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0
Jun 16 18:52:52 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:53 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3e21d518-3e73-4bac-94bb-18d3d164b6f0" returned: 0 in 0.664s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Lock "cinder-quobyte-3e21d518-3e73-4bac-94bb-18d3d164b6f0" released by "delete_volume" :: held 2.300s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Created reservations ['f2795cbe-aa22-494d-9e6c-56de0e184997', 'ad9ad140-a4af-42c7-9bc9-b3e07b356515', '65c31210-8138-434e-b52b-efbd95e0c399', 'd72740d6-caac-479b-a536-e428c8679b93'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:53 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:52:53 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:54 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.615s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:54 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:52:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Deleted volume successfully.
Jun 16 18:52:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-20b6a6db-601e-4089-8c7d-3f1b56da8357 tempest-VolumesImageMetadata-832678047 None] Lock "cinder-3e21d518-3e73-4bac-94bb-18d3d164b6f0-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:52:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Flow 'volume_create_manager' (3f84ff59-d48d-478c-8da6-40d47364c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d414ee24-9cf2-4904-b3b7-b317b050f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d414ee24-9cf2-4904-b3b7-b317b050f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-674854374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2febcc-067d-436e-9aa1-f55bd5ecc856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334389996538463696dec04ce127bf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:57Z,use_quota=True,user_id='576e7204fcae478b851ab1351fc5ecee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc47e00d-fa96-4b86-8450-c2fcd6bca7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc47e00d-fa96-4b86-8450-c2fcd6bca7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62361272-e6e2-4987-ac7e-cc25ddd32e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62361272-e6e2-4987-ac7e-cc25ddd32e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2febcc-067d-436e-9aa1-f55bd5ecc856', 'volume_name': 'volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666112b5-0412-43c4-b3bd-7e2b9286f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666112b5-0412-43c4-b3bd-7e2b9286f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77abdefd-25a4-4517-8a11-19218c30be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:57 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Volume 5e2febcc-067d-436e-9aa1-f55bd5ecc856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856', 'volume_size': 1}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-674854374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2febcc-067d-436e-9aa1-f55bd5ecc856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334389996538463696dec04ce127bf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:52:57Z,use_quota=True,user_id='576e7204fcae478b851ab1351fc5ecee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Creating volume 5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:52:57 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:57 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 1073741824
Jun 16 18:52:57 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:57 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 1073741824" returned: 0 in 0.838s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:57 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856
Jun 16 18:52:57 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:52:58 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856" returned: 0 in 0.591s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77abdefd-25a4-4517-8a11-19218c30be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57afb44f-655c-42ed-953b-1b2ed867468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:52:58 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Volume volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 (5e2febcc-067d-436e-9aa1-f55bd5ecc856): created successfully
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57afb44f-655c-42ed-953b-1b2ed867468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:52:58 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Flow 'volume_create_manager' (3f84ff59-d48d-478c-8da6-40d47364c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:52:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9b8f086a-a2f0-4803-b11b-d55099ceb5d2 tempest-VolumesDeleteCascade-1168162003 None] Created volume successfully.
Jun 16 18:52:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:52:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:52:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Creating offline snapshot 831b7774-2f56-48d7-a284-d0499ba1a3b6 of volume 5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:52:59 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee922bdc-0327-4978-9014-8575a1487e99]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:52:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:52:59 devstack sudo[107840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856
Jun 16 18:52:59 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:00 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856" returned: 0 in 0.706s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:00 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 1G
Jun 16 18:53:00 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:00 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 1G" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:00 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:00 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:01 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.643s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:01 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 is being set with open permissions: ugo+rw
Jun 16 18:53:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:01 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:01 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:02 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.600s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:02 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info
Jun 16 18:53:02 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:02 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info" returned: 0 in 0.707s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:02 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info is being set with open permissions: ugo+rw
Jun 16 18:53:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:02 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info
Jun 16 18:53:02 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:03 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.info" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.128s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9d7ea0e4-7625-4567-b7a3-4e4d162aff6b tempest-VolumesDeleteCascade-1168162003 None] Create snapshot completed successfully
Jun 16 18:53:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Creating offline snapshot 10447ce0-6aa0-42d4-bb1c-0f00292d8f38 of volume 5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:53:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[576fd2a5-ae0a-4bc3-837d-51fc202da948]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:04 devstack sudo[107884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:04 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:05 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.742s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:53:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:05 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 1G
Jun 16 18:53:05 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:06 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 1G" returned: 0 in 0.796s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:06 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38
Jun 16 18:53:06 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:06 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38" returned: 0 in 0.648s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:06 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 is being set with open permissions: ugo+rw
Jun 16 18:53:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:06 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38
Jun 16 18:53:06 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:07 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38" returned: 0 in 0.603s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:07 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-928a4ce7-271b-4bc0-9013-5d0402ee0467 tempest-VolumesDeleteCascade-1168162003 None] Create snapshot completed successfully
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-5e2febcc-067d-436e-9aa1-f55bd5ecc856-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-5e2febcc-067d-436e-9aa1-f55bd5ecc856-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Performing cascade delete. {{(pid=91851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-10447ce0-6aa0-42d4-bb1c-0f00292d8f38-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-10447ce0-6aa0-42d4-bb1c-0f00292d8f38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" acquired by "delete_snapshot" :: waited 0.012s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-10447ce0-6aa0-42d4-bb1c-0f00292d8f38" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-10447ce0-6aa0-42d4-bb1c-0f00292d8f38" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Deleting offline snapshot 10447ce0-6aa0-42d4-bb1c-0f00292d8f38 of volume 5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] snapshot_file for this snap is: volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7514fa21-008d-4ef8-8646-028b6b7fa4e5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:08 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38
Jun 16 18:53:08 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:09 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38" returned: 0 in 1.072s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[23548902-2ca9-4182-a7cc-484251fd21ef]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:09 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:09 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:09 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.763s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:53:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:09 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38
Jun 16 18:53:09 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:10 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:10 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38
Jun 16 18:53:10 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:11 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.10447ce0-6aa0-42d4-bb1c-0f00292d8f38" returned: 0 in 0.651s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-10447ce0-6aa0-42d4-bb1c-0f00292d8f38" released by "_delete_snapshot" :: held 3.427s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" released by "delete_snapshot" :: held 3.453s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Created reservations ['f3faf38d-e3b3-40bb-a92e-58308a810968', '2d31dcce-c7e3-4c67-ac63-ce718cbaefd7', '2e014dac-73fb-4406-a9e1-f2399ef24884', '042f2ade-0d19-4f24-989d-6372503021a2'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:11 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Delete snapshot completed successfully.
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-10447ce0-6aa0-42d4-bb1c-0f00292d8f38-delete_snapshot" released by "delete_snapshot" :: held 3.637s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-831b7774-2f56-48d7-a284-d0499ba1a3b6-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-831b7774-2f56-48d7-a284-d0499ba1a3b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-831b7774-2f56-48d7-a284-d0499ba1a3b6" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-831b7774-2f56-48d7-a284-d0499ba1a3b6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Deleting offline snapshot 831b7774-2f56-48d7-a284-d0499ba1a3b6 of volume 5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] snapshot_file for this snap is: volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c39d32-3ad9-4e00-94cf-d8771bc097b9]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:11 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:11 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:12 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.790s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:53:12 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ebd6d-b75d-4a9c-8bfd-6210b7199c2b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:12 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856
Jun 16 18:53:12 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:13 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856" returned: 0 in 0.736s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:13 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:13 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:13 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.684s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:13 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6
Jun 16 18:53:13 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:14 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856.831b7774-2f56-48d7-a284-d0499ba1a3b6" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-831b7774-2f56-48d7-a284-d0499ba1a3b6" released by "_delete_snapshot" :: held 2.978s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" released by "delete_snapshot" :: held 3.005s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Created reservations ['c763293d-cd0c-4664-b3aa-8a9beead497a', '43b659f4-4098-488a-a462-62c188b9f7f3', 'e851b44f-3a37-4d4e-893a-ce63be827eed', '6c46538b-259e-4fa1-b4c9-edb5d0e92876'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Delete snapshot completed successfully.
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-831b7774-2f56-48d7-a284-d0499ba1a3b6-delete_snapshot" released by "delete_snapshot" :: held 3.157s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Snapshots deleted, issuing volume delete {{(pid=91851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9872af8-c45c-4a6a-8958-d31155621b6c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:14 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856
Jun 16 18:53:14 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:15 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856" returned: 0 in 0.744s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:15 devstack sudo[108019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856
Jun 16 18:53:15 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:16 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-5e2febcc-067d-436e-9aa1-f55bd5ecc856" returned: 0 in 0.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-5e2febcc-067d-436e-9aa1-f55bd5ecc856" released by "delete_volume" :: held 1.393s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Created reservations ['16cf26e8-0428-45f5-b668-e47cbedf0479', 'ab16036f-6bfd-470c-a441-26c8739419a1', '0d78f866-22bd-439b-80f2-c946ec8efd99', '603b2448-0025-48fa-bbb9-ece3ea2f9cc9'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:16 devstack sudo[108022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:16 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:16 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.620s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Deleted volume successfully.
Jun 16 18:53:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2a71ea1e-511b-45bc-9246-7accfed359b7 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-5e2febcc-067d-436e-9aa1-f55bd5ecc856-delete_volume" released by "delete_volume" :: held 9.049s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Flow 'volume_create_manager' (d6fbe4f2-ab7c-46f3-ac4f-156271e83362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7ae2fa-dd41-4922-9f6a-faffa5dc9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7ae2fa-dd41-4922-9f6a-faffa5dc9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2081574770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd53c24c-4fa0-4c24-834a-bd0ea78408cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334389996538463696dec04ce127bf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:17Z,use_quota=True,user_id='576e7204fcae478b851ab1351fc5ecee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abafdc2b-3ed8-47b5-b328-9b5b2002bc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abafdc2b-3ed8-47b5-b328-9b5b2002bc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d5ca5c-50cd-4aec-b795-f17e38c3e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d5ca5c-50cd-4aec-b795-f17e38c3e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd53c24c-4fa0-4c24-834a-bd0ea78408cb', 'volume_name': 'volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cfac28-c8b1-4c91-89f3-6a95c8631f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cfac28-c8b1-4c91-89f3-6a95c8631f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a79aa4-cd15-49fb-a8b9-7158cc613ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Volume cd53c24c-4fa0-4c24-834a-bd0ea78408cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb', 'volume_size': 1}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2081574770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd53c24c-4fa0-4c24-834a-bd0ea78408cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334389996538463696dec04ce127bf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:17Z,use_quota=True,user_id='576e7204fcae478b851ab1351fc5ecee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Creating volume cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:53:17 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:53:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:17 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb 1073741824
Jun 16 18:53:17 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:17 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb 1073741824" returned: 0 in 0.784s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:18 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:18 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:18 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.619s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a79aa4-cd15-49fb-a8b9-7158cc613ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d305f3-36a0-4015-9bc8-9fc4d3dffd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Volume volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb (cd53c24c-4fa0-4c24-834a-bd0ea78408cb): created successfully
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d305f3-36a0-4015-9bc8-9fc4d3dffd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Flow 'volume_create_manager' (d6fbe4f2-ab7c-46f3-ac4f-156271e83362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4ae2f8dc-5a20-466d-a362-407c250b587a tempest-VolumesDeleteCascade-1168162003 None] Created volume successfully.
Jun 16 18:53:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Creating offline snapshot e44b1dad-7a69-40c5-a4e1-917030f6e596 of volume cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:53:19 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c2dce5-c494-44b8-ad06-439a5b70b73a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:19 devstack sudo[108033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:19 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:20 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.731s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:20 devstack sudo[108039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 1G
Jun 16 18:53:20 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:20 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 1G" returned: 0 in 0.778s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:21 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596
Jun 16 18:53:21 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:21 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596" returned: 0 in 0.729s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:21 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 is being set with open permissions: ugo+rw
Jun 16 18:53:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:21 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596
Jun 16 18:53:21 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:22 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:22 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info
Jun 16 18:53:22 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:22 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info" returned: 0 in 0.582s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:22 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info is being set with open permissions: ugo+rw
Jun 16 18:53:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:22 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info
Jun 16 18:53:22 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:23 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.info" returned: 0 in 0.592s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.098s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9e83863c-7fdb-4398-a190-c586a5815763 tempest-VolumesDeleteCascade-1168162003 None] Create snapshot completed successfully
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=67,cinder:INSERT=24,cinder:UPDATE=73,cinder:DELETE=8 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Flow 'volume_create_manager' (8e20151d-46c4-434e-8090-6641fb547b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69417f1-6e8e-4f27-b460-4bada12e7d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69417f1-6e8e-4f27-b460-4bada12e7d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2036542495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0928713b-687d-4493-ab30-1d52e1beaa8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334389996538463696dec04ce127bf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e44b1dad-7a69-40c5-a4e1-917030f6e596,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:25Z,use_quota=True,user_id='576e7204fcae478b851ab1351fc5ecee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a834d818-6bf9-4e70-a310-4bc15d808321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a834d818-6bf9-4e70-a310-4bc15d808321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71d1bac-7f9f-4609-8634-2e094909a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71d1bac-7f9f-4609-8634-2e094909a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0928713b-687d-4493-ab30-1d52e1beaa8e', 'volume_name': 'volume-0928713b-687d-4493-ab30-1d52e1beaa8e', 'volume_size': 1, 'snapshot_id': 'e44b1dad-7a69-40c5-a4e1-917030f6e596'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58063ac7-672d-4cd8-a4ef-d645b1c2c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58063ac7-672d-4cd8-a4ef-d645b1c2c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b498d3f0-15dd-4af8-a45c-ad8a6af0e557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:25 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Volume 0928713b-687d-4493-ab30-1d52e1beaa8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0928713b-687d-4493-ab30-1d52e1beaa8e', 'volume_size': 1, 'snapshot_id': 'e44b1dad-7a69-40c5-a4e1-917030f6e596'}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=83,cinder:DELETE=6,cinder:SELECT=67,cinder:INSERT=27 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-e44b1dad-7a69-40c5-a4e1-917030f6e596-0928713b-687d-4493-ab30-1d52e1beaa8e" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-e44b1dad-7a69-40c5-a4e1-917030f6e596-0928713b-687d-4493-ab30-1d52e1beaa8e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Creating volume 0928713b-687d-4493-ab30-1d52e1beaa8e from snapshot e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-0928713b-687d-4493-ab30-1d52e1beaa8e" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-0928713b-687d-4493-ab30-1d52e1beaa8e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] snapshot: e44b1dad-7a69-40c5-a4e1-917030f6e596, volume: 0928713b-687d-4493-ab30-1d52e1beaa8e,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f44be13-464d-4e2e-b0a8-3e27e170b5e2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:25 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596
Jun 16 18:53:25 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:25 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596" returned: 0 in 0.680s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a2d2c9-b2bc-4b27-8156-528a7f4ce1dc]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:26 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:26 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:26 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.701s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:26 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:53:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:26 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e
Jun 16 18:53:26 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:32 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e" returned: 0 in 5.449s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deaba4a-6056-4650-807e-8f1da4d970de]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:32 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:32 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:32 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.896s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:53:33 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Converted 1024.00 MB image at 187.89 MB/s
Jun 16 18:53:33 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e is being set with open permissions: ugo+rw
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:33 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e
Jun 16 18:53:33 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:33 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e" returned: 0 in 0.580s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-0928713b-687d-4493-ab30-1d52e1beaa8e" released by "_copy_volume_from_snapshot" :: held 8.396s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-e44b1dad-7a69-40c5-a4e1-917030f6e596-0928713b-687d-4493-ab30-1d52e1beaa8e" released by "_create_volume_from_snapshot" :: held 8.424s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.438s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b498d3f0-15dd-4af8-a45c-ad8a6af0e557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0928713b-687d-4493-ab30-1d52e1beaa8e', 'volume_size': 1, 'snapshot_id': 'e44b1dad-7a69-40c5-a4e1-917030f6e596'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b912db-590a-49ba-95e0-111ecb74e316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:33 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Volume volume-0928713b-687d-4493-ab30-1d52e1beaa8e (0928713b-687d-4493-ab30-1d52e1beaa8e): created successfully
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b912db-590a-49ba-95e0-111ecb74e316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Flow 'volume_create_manager' (8e20151d-46c4-434e-8090-6641fb547b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-db61d0f3-4ba5-4aaf-870d-23c1809a287e tempest-VolumesDeleteCascade-1168162003 None] Created volume successfully.
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Flow 'volume_create_manager' (ca0f4515-628a-4be8-9c94-1efeee9bd149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5d7867-cb22-41f2-b0d3-7f89d05da3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5d7867-cb22-41f2-b0d3-7f89d05da3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-961993128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607fb015-4c30-4a17-b382-d69022fd3a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babf514be41846f496370af98109e3cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:34Z,use_quota=True,user_id='77322d6b50fe4714bfbda7ebab29feae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4028b836-d46a-44dd-aaee-b00c7b3b6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4028b836-d46a-44dd-aaee-b00c7b3b6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b34732-4970-4d6c-82ce-e519bc7391e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b34732-4970-4d6c-82ce-e519bc7391e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607fb015-4c30-4a17-b382-d69022fd3a9b', 'volume_name': 'volume-607fb015-4c30-4a17-b382-d69022fd3a9b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06cd7321-f0ca-49e0-a811-5288da125c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06cd7321-f0ca-49e0-a811-5288da125c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da55e36e-fc0c-4c3a-9dd0-485dee3069b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:34 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Volume 607fb015-4c30-4a17-b382-d69022fd3a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607fb015-4c30-4a17-b382-d69022fd3a9b', 'volume_size': 1}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-961993128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607fb015-4c30-4a17-b382-d69022fd3a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babf514be41846f496370af98109e3cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:34Z,use_quota=True,user_id='77322d6b50fe4714bfbda7ebab29feae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Creating volume 607fb015-4c30-4a17-b382-d69022fd3a9b {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:53:34 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:34 devstack sudo[108153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b 1073741824
Jun 16 18:53:34 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-cd53c24c-4fa0-4c24-834a-bd0ea78408cb-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-cd53c24c-4fa0-4c24-834a-bd0ea78408cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Performing cascade delete. {{(pid=91851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-e44b1dad-7a69-40c5-a4e1-917030f6e596-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-e44b1dad-7a69-40c5-a4e1-917030f6e596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-e44b1dad-7a69-40c5-a4e1-917030f6e596" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-e44b1dad-7a69-40c5-a4e1-917030f6e596" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Deleting offline snapshot e44b1dad-7a69-40c5-a4e1-917030f6e596 of volume cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] snapshot_file for this snap is: volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2223aa9-014b-4705-a956-6df3b4c6729e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:34 devstack sudo[108155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596
Jun 16 18:53:34 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:34 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b 1073741824" returned: 0 in 0.782s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:34 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b
Jun 16 18:53:34 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:34 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596" returned: 0 in 0.725s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b3a0f3-2940-46f2-9e5b-f41dfeda7c64]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:35 devstack sudo[108166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:35 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:35 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b" returned: 0 in 0.604s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da55e36e-fc0c-4c3a-9dd0-485dee3069b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607fb015-4c30-4a17-b382-d69022fd3a9b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dd429c-315c-43fa-9bc8-4caf02e1a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:35 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Volume volume-607fb015-4c30-4a17-b382-d69022fd3a9b (607fb015-4c30-4a17-b382-d69022fd3a9b): created successfully
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dd429c-315c-43fa-9bc8-4caf02e1a347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Flow 'volume_create_manager' (ca0f4515-628a-4be8-9c94-1efeee9bd149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1c37e5df-1ea1-4bfb-8f7e-4699bae4043c tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Created volume successfully.
Jun 16 18:53:35 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.688s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:35 devstack sudo[108172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596
Jun 16 18:53:35 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:36 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596" returned: 0 in 0.724s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:36 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596
Jun 16 18:53:36 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:37 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb.e44b1dad-7a69-40c5-a4e1-917030f6e596" returned: 0 in 0.575s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-e44b1dad-7a69-40c5-a4e1-917030f6e596" released by "_delete_snapshot" :: held 2.796s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" released by "delete_snapshot" :: held 2.816s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Created reservations ['52e94b0e-6ea7-4151-a56e-f396acc3ba59', '878eac2f-2f0b-41da-8d6d-e63b34493585', '9ef01688-c907-4852-86b0-14272e9417f8', 'f7fa55c2-83c9-4562-989a-f9d754de9737'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Delete snapshot completed successfully.
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-e44b1dad-7a69-40c5-a4e1-917030f6e596-delete_snapshot" released by "delete_snapshot" :: held 2.949s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Snapshots deleted, issuing volume delete {{(pid=91851) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[101c9246-4eb3-4a1a-a113-35cd71a92a48]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:37 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:37 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:37 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.691s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:37 devstack sudo[108187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb
Jun 16 18:53:37 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:38 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" returned: 0 in 0.593s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-cd53c24c-4fa0-4c24-834a-bd0ea78408cb" released by "delete_volume" :: held 1.342s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Created reservations ['4d8d4c82-6257-4c28-88ba-9545f78f9229', '58d2b1cd-44c7-44d5-b915-1760a18f9512', '40455c59-51e9-4773-b1e7-4e942bb3344d', '60893354-4299-498f-9d0e-ce0f4c8bdd44'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:38 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:38 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3c9bdc-132e-43bc-a1cd-792e2f3149c1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:39 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.583s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Deleted volume successfully.
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f69971c9-619c-4cf0-8421-023d9a62d5a1 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-cd53c24c-4fa0-4c24-834a-bd0ea78408cb-delete_volume" released by "delete_volume" :: held 5.071s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:39 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b
Jun 16 18:53:39 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-0928713b-687d-4493-ab30-1d52e1beaa8e-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-0928713b-687d-4493-ab30-1d52e1beaa8e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "cinder-quobyte-0928713b-687d-4493-ab30-1d52e1beaa8e" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-0928713b-687d-4493-ab30-1d52e1beaa8e" acquired by "delete_volume" :: waited 0.038s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[abad5614-beb5-42a8-8eec-4657c0125cba]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:39 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e
Jun 16 18:53:39 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:39 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b" returned: 0 in 0.766s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-607fb015-4c30-4a17-b382-d69022fd3a9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbffccd8-5918-4df7-9961-bfef440cda90', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:53:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-11806168-bb05-42c1-b0e4-7af006fdf1b9 req-34b10c25-6adb-4529-a75e-61d4d19986d3 tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] attachment_update completed successfully.
Jun 16 18:53:40 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e" returned: 0 in 0.729s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:40 devstack sudo[108279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e
Jun 16 18:53:40 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:41 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0928713b-687d-4493-ab30-1d52e1beaa8e" returned: 0 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-quobyte-0928713b-687d-4493-ab30-1d52e1beaa8e" released by "delete_volume" :: held 1.437s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Created reservations ['ca9927a8-44f6-4cf2-bdd5-313cf60573e4', 'f2adde1d-6428-4fae-bdc1-8b49bb183e8f', '3c7ba9e4-f6e0-4729-9250-7c6b4d2bab0a', '59e90724-3946-422a-9291-68c3dff89420'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:41 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:41 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:41 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.587s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Deleted volume successfully.
Jun 16 18:53:41 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-1bf0667d-fb47-4ac6-b7da-90d29f338bc2 tempest-VolumesDeleteCascade-1168162003 None] Lock "cinder-0928713b-687d-4493-ab30-1d52e1beaa8e-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:42 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:42 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:42 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.617s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:53:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Flow 'volume_create_manager' (2d7a8632-363d-4a3e-9b89-807d0d3e778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bb5397-029d-4da2-b4e7-667d9795381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bb5397-029d-4da2-b4e7-667d9795381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-616610916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5f8fb8-2df2-4c23-b1b7-e46695d213fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cbfc1b76a5d4a119e42379907004b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:45Z,use_quota=True,user_id='1b0a43bc6f0141acaaccddcdbe126583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9049d29-4b7d-4803-a593-bf78061a1b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9049d29-4b7d-4803-a593-bf78061a1b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5b185b-14a3-4046-aa7e-86338f8fc35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5b185b-14a3-4046-aa7e-86338f8fc35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5f8fb8-2df2-4c23-b1b7-e46695d213fa', 'volume_name': 'volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf44686-57f2-486f-8da1-948eb0774567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf44686-57f2-486f-8da1-948eb0774567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac01a3f1-241b-4cda-9183-9698259d86d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:44 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Volume 0e5f8fb8-2df2-4c23-b1b7-e46695d213fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa', 'volume_size': 1}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-616610916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5f8fb8-2df2-4c23-b1b7-e46695d213fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cbfc1b76a5d4a119e42379907004b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:45Z,use_quota=True,user_id='1b0a43bc6f0141acaaccddcdbe126583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Creating volume 0e5f8fb8-2df2-4c23-b1b7-e46695d213fa {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:53:44 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:53:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:44 devstack sudo[108603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa 1073741824
Jun 16 18:53:44 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:45 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa 1073741824" returned: 0 in 0.829s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:45 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa
Jun 16 18:53:45 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:46 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa" returned: 0 in 0.582s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac01a3f1-241b-4cda-9183-9698259d86d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91de1ad-fc1b-4c30-b0ac-fd22133c1a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:46 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Volume volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa (0e5f8fb8-2df2-4c23-b1b7-e46695d213fa): created successfully
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91de1ad-fc1b-4c30-b0ac-fd22133c1a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Flow 'volume_create_manager' (2d7a8632-363d-4a3e-9b89-807d0d3e778a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7899b4f1-eaff-4cd4-aa8d-39cd1da0014f tempest-VolumesListTestJSON-1489600341 None] Created volume successfully.
Jun 16 18:53:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-290f01a0-10ac-4096-b460-d87531e04865 req-1f06ffa2-d890-4a7e-a114-2c5b4339623f tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Terminate volume connection completed successfully.
Jun 16 18:53:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-290f01a0-10ac-4096-b460-d87531e04865 req-1f06ffa2-d890-4a7e-a114-2c5b4339623f tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Deleting attachment dbffccd8-5918-4df7-9961-bfef440cda90. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Flow 'volume_create_manager' (29d9e877-7895-4f41-b3f0-303d050ef7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2043d4ec-cc08-4e37-b53f-1052166b542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2043d4ec-cc08-4e37-b53f-1052166b542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013036510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2997ab-d445-44c0-a81e-7d38e2c1a91f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cbfc1b76a5d4a119e42379907004b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:47Z,use_quota=True,user_id='1b0a43bc6f0141acaaccddcdbe126583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5643a4f8-2842-470b-8c7f-81da4e06f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5643a4f8-2842-470b-8c7f-81da4e06f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c9d5ff-7a32-47c9-8c01-ca96cb6691cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c9d5ff-7a32-47c9-8c01-ca96cb6691cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2997ab-d445-44c0-a81e-7d38e2c1a91f', 'volume_name': 'volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bbbf2b-6ad4-4784-beb7-79ebd1002c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bbbf2b-6ad4-4784-beb7-79ebd1002c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb1fc6e-5541-412a-802a-1237d9bf19d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:47 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Volume ad2997ab-d445-44c0-a81e-7d38e2c1a91f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f', 'volume_size': 1}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013036510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2997ab-d445-44c0-a81e-7d38e2c1a91f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cbfc1b76a5d4a119e42379907004b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:47Z,use_quota=True,user_id='1b0a43bc6f0141acaaccddcdbe126583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Creating volume ad2997ab-d445-44c0-a81e-7d38e2c1a91f {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:53:47 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:53:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:47 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f 1073741824
Jun 16 18:53:47 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:48 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f 1073741824" returned: 0 in 0.773s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:48 devstack sudo[108645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f
Jun 16 18:53:48 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:48 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb1fc6e-5541-412a-802a-1237d9bf19d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5234b73c-5733-46ef-b371-7fc1a232a947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Volume volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f (ad2997ab-d445-44c0-a81e-7d38e2c1a91f): created successfully
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5234b73c-5733-46ef-b371-7fc1a232a947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Flow 'volume_create_manager' (29d9e877-7895-4f41-b3f0-303d050ef7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3322a94d-03e2-4efc-a38d-64077e9316b1 tempest-VolumesListTestJSON-1489600341 None] Created volume successfully.
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Acquiring lock "cinder-607fb015-4c30-4a17-b382-d69022fd3a9b-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "cinder-607fb015-4c30-4a17-b382-d69022fd3a9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Acquiring lock "cinder-quobyte-607fb015-4c30-4a17-b382-d69022fd3a9b" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "cinder-quobyte-607fb015-4c30-4a17-b382-d69022fd3a9b" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba8eea-1794-4995-93a4-7f2e59fc2b22]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:49 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b
Jun 16 18:53:49 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:49 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b" returned: 0 in 0.740s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:49 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b
Jun 16 18:53:49 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Flow 'volume_create_manager' (71cbd1d9-f74c-46b5-a1a3-50590205e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219345b8-2500-4a1d-a426-1b9ded60e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219345b8-2500-4a1d-a426-1b9ded60e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1229742866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c4b624-2d5e-456c-bd63-3becae57183f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cbfc1b76a5d4a119e42379907004b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:50Z,use_quota=True,user_id='1b0a43bc6f0141acaaccddcdbe126583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a617aa-8964-43bc-9243-0e9d015807b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a617aa-8964-43bc-9243-0e9d015807b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa083be7-9bf3-473b-898d-dba4c58ee41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa083be7-9bf3-473b-898d-dba4c58ee41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c4b624-2d5e-456c-bd63-3becae57183f', 'volume_name': 'volume-84c4b624-2d5e-456c-bd63-3becae57183f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b485adf3-66e1-42ec-8a99-d2b69e340f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b485adf3-66e1-42ec-8a99-d2b69e340f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c79804d-5207-470e-98b4-589d036ccd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:49 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Volume 84c4b624-2d5e-456c-bd63-3becae57183f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c4b624-2d5e-456c-bd63-3becae57183f', 'volume_size': 1}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1229742866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c4b624-2d5e-456c-bd63-3becae57183f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cbfc1b76a5d4a119e42379907004b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:53:50Z,use_quota=True,user_id='1b0a43bc6f0141acaaccddcdbe126583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Creating volume 84c4b624-2d5e-456c-bd63-3becae57183f {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:53:49 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:53:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:49 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f 1073741824
Jun 16 18:53:49 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:50 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-607fb015-4c30-4a17-b382-d69022fd3a9b" returned: 0 in 0.586s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "cinder-quobyte-607fb015-4c30-4a17-b382-d69022fd3a9b" released by "delete_volume" :: held 1.367s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Created reservations ['9d428127-6135-4e5d-ad1a-4e0adb616b05', '0851b3b1-7289-4a44-b7c1-163dd9166196', '8e419226-3284-41c7-a853-15f11985bf9a', '66e2e106-ac3f-47f3-b542-9d30e942b93f'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:50 devstack sudo[108661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:50 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:50 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f 1073741824" returned: 0 in 0.765s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:50 devstack sudo[108664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f
Jun 16 18:53:50 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:51 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.640s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Deleted volume successfully.
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9392f4c0-9066-4a6f-b192-07885ae1898a tempest-TestServerVolumeAttachScenarioOldVersion-1044392299 None] Lock "cinder-607fb015-4c30-4a17-b382-d69022fd3a9b-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:51 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c79804d-5207-470e-98b4-589d036ccd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c4b624-2d5e-456c-bd63-3becae57183f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875b0c16-948c-4e3f-9dd5-4026c68f193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:53:51 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Volume volume-84c4b624-2d5e-456c-bd63-3becae57183f (84c4b624-2d5e-456c-bd63-3becae57183f): created successfully
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875b0c16-948c-4e3f-9dd5-4026c68f193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:53:51 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Flow 'volume_create_manager' (71cbd1d9-f74c-46b5-a1a3-50590205e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:53:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2ddd71f3-8ac7-4430-90c2-4ed36ecee743 tempest-VolumesListTestJSON-1489600341 None] Created volume successfully.
Jun 16 18:53:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "cinder-84c4b624-2d5e-456c-bd63-3becae57183f-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-84c4b624-2d5e-456c-bd63-3becae57183f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "cinder-quobyte-84c4b624-2d5e-456c-bd63-3becae57183f" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-quobyte-84c4b624-2d5e-456c-bd63-3becae57183f" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:54 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9587fd-1128-42c7-8fec-0eb4ee4c9390]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:54 devstack sudo[108710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f
Jun 16 18:53:54 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:54 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f" returned: 0 in 0.737s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:54 devstack sudo[108716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f
Jun 16 18:53:54 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:55 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-84c4b624-2d5e-456c-bd63-3becae57183f" returned: 0 in 0.592s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-quobyte-84c4b624-2d5e-456c-bd63-3becae57183f" released by "delete_volume" :: held 1.382s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Created reservations ['689ab4e0-f48d-419b-ad85-049c2669f72a', '8c074987-e0b1-4340-92fd-5d7cfc808f7b', 'a64fcc2f-53dc-4085-85e5-8bcbc013435a', '1467447f-d3eb-40f6-8bd4-34f74b884922'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:55 devstack sudo[108719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:55 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:56 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.583s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Deleted volume successfully.
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e6bf0f50-663a-458c-a5a7-311babd71260 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-84c4b624-2d5e-456c-bd63-3becae57183f-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "cinder-ad2997ab-d445-44c0-a81e-7d38e2c1a91f-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-ad2997ab-d445-44c0-a81e-7d38e2c1a91f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "cinder-quobyte-ad2997ab-d445-44c0-a81e-7d38e2c1a91f" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-quobyte-ad2997ab-d445-44c0-a81e-7d38e2c1a91f" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8c9d4-74b4-4be3-8959-16028e42148f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:56 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f
Jun 16 18:53:56 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:57 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f" returned: 0 in 0.721s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:57 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f
Jun 16 18:53:57 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:57 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ad2997ab-d445-44c0-a81e-7d38e2c1a91f" returned: 0 in 0.628s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-quobyte-ad2997ab-d445-44c0-a81e-7d38e2c1a91f" released by "delete_volume" :: held 1.394s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Created reservations ['7b1e4c68-ca94-473c-a064-ecbe936a0e50', '2d81291d-7fc7-46b8-9933-46c3c2bf0c6c', '4131e55e-0ae5-4a58-ae35-0d2e5244021e', '05f78a37-04dc-474c-8f8c-63cd7f3f78aa'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:53:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:57 devstack sudo[108732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:53:57 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:58 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.584s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:53:58 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Deleted volume successfully.
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-3e5d71cd-a316-4f6d-8f79-c29da6664e3b tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-ad2997ab-d445-44c0-a81e-7d38e2c1a91f-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "cinder-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "cinder-quobyte-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-quobyte-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b7630-5e5a-4ad1-959c-2c9ae5cabfa1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:53:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:58 devstack sudo[108735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa
Jun 16 18:53:58 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:53:59 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root
Jun 16 18:53:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa" returned: 0 in 0.782s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:53:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:53:59 devstack sudo[108740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa
Jun 16 18:53:59 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:00 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa" returned: 0 in 0.662s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-quobyte-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa" released by "delete_volume" :: held 1.491s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Created reservations ['49925a8a-afb7-4b00-953c-eecea4279c69', 'a2b06ceb-0556-47b8-99f6-0d5f89874727', '0677d195-1623-419e-b6db-a062eedf40a7', 'e4f61642-abac-4801-8541-69c5a52364b4'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:00 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:00 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:00 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Deleted volume successfully.
Jun 16 18:54:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6d9f323c-4592-462f-a878-7b79658f8cd8 tempest-VolumesListTestJSON-1489600341 None] Lock "cinder-0e5f8fb8-2df2-4c23-b1b7-e46695d213fa-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:10 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=51,cinder:UPDATE=68,cinder:DELETE=4,cinder:INSERT=16 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:54:10 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=52,cinder:UPDATE=69,cinder:INSERT=16,cinder:DELETE=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (711350b1-263c-4c99-b834-52a9ea783dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb9386f-4cd4-4cbd-9434-014449d0bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb9386f-4cd4-4cbd-9434-014449d0bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1636832349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc8d080-584a-4328-89c9-451621e88c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:11Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee4338b-fc79-4234-9c99-d41a0ea3aeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee4338b-fc79-4234-9c99-d41a0ea3aeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d65af8-d9b3-4451-a190-caf42cf11abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d65af8-d9b3-4451-a190-caf42cf11abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc8d080-584a-4328-89c9-451621e88c20', 'volume_name': 'volume-ebc8d080-584a-4328-89c9-451621e88c20', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66dbd3a-6532-4e01-8cd3-e7ad9fcd0a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66dbd3a-6532-4e01-8cd3-e7ad9fcd0a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744138f6-6fd2-42ff-8ce5-c0d94cd4658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:11 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume ebc8d080-584a-4328-89c9-451621e88c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc8d080-584a-4328-89c9-451621e88c20', 'volume_size': 1}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1636832349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc8d080-584a-4328-89c9-451621e88c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:11Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating volume ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:11 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:11 devstack sudo[108756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 1073741824
Jun 16 18:54:11 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:11 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (33e2cae6-0ce0-4679-9958-9fcf4b1a02af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e93670-631c-4f3d-ab9e-6c851529456c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e93670-631c-4f3d-ab9e-6c851529456c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-341246724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f329b79-a53d-4bae-bd16-cf717d8be6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:12Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab2b211-26bc-4c20-b5bf-36e61971e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab2b211-26bc-4c20-b5bf-36e61971e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112214c8-66fa-4a47-94d6-53f630e9bfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112214c8-66fa-4a47-94d6-53f630e9bfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f329b79-a53d-4bae-bd16-cf717d8be6c2', 'volume_name': 'volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5896444-226f-4d16-b667-2ecf782b9bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5896444-226f-4d16-b667-2ecf782b9bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdf5c80-26ae-4fd3-8ece-737d48e81ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:12 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Volume 4f329b79-a53d-4bae-bd16-cf717d8be6c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2', 'volume_size': 1}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:12 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 1073741824" returned: 0 in 0.827s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:12 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20
Jun 16 18:54:12 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:12 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-341246724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f329b79-a53d-4bae-bd16-cf717d8be6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:12Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Creating volume 4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:12 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744138f6-6fd2-42ff-8ce5-c0d94cd4658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc8d080-584a-4328-89c9-451621e88c20', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:12 devstack sudo[108765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 1073741824
Jun 16 18:54:12 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cab900d-0ba9-47b2-95a9-f4b0a632aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:12 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume volume-ebc8d080-584a-4328-89c9-451621e88c20 (ebc8d080-584a-4328-89c9-451621e88c20): created successfully
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cab900d-0ba9-47b2-95a9-f4b0a632aeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (711350b1-263c-4c99-b834-52a9ea783dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-835e9748-7b47-47df-938e-4efede1a09a3 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created volume successfully.
Jun 16 18:54:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:13 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 1073741824" returned: 0 in 0.798s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:13 devstack sudo[108771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2
Jun 16 18:54:13 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:14 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2" returned: 0 in 0.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.683s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating offline snapshot 4099ced6-ab13-44fc-b531-1df2ee42cc77 of volume ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdf5c80-26ae-4fd3-8ece-737d48e81ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43900334-f09b-4481-8698-cd6fbc5c5afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[84341f04-9498-44dd-927d-bfebfadd4c80]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:14 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Volume volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 (4f329b79-a53d-4bae-bd16-cf717d8be6c2): created successfully
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43900334-f09b-4481-8698-cd6fbc5c5afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (33e2cae6-0ce0-4679-9958-9fcf4b1a02af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-07713fb3-907d-41eb-8549-e0772c354f22 tempest-VolumesSnapshotTestJSON-902116570 None] Created volume successfully.
Jun 16 18:54:14 devstack sudo[108774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20
Jun 16 18:54:14 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:15 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20" returned: 0 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:15 devstack sudo[108779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 1G
Jun 16 18:54:15 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:15 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 1G" returned: 0 in 0.730s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc8d080-584a-4328-89c9-451621e88c20 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:15 devstack sudo[108785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc8d080-584a-4328-89c9-451621e88c20 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77
Jun 16 18:54:15 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:16 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc8d080-584a-4328-89c9-451621e88c20 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77" returned: 0 in 0.623s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:16 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 is being set with open permissions: ugo+rw
Jun 16 18:54:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:16 devstack sudo[108791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77
Jun 16 18:54:16 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:17 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:17 devstack sudo[108794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info
Jun 16 18:54:17 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:17 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info" returned: 0 in 0.578s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:17 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info is being set with open permissions: ugo+rw
Jun 16 18:54:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:17 devstack sudo[108797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info
Jun 16 18:54:17 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:18 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.info" returned: 0 in 0.573s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.888s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.783s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Creating offline snapshot 66c2416d-f30b-49d4-906d-d629823c4a9e of volume 4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:54:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6f3fea42-8d33-4a71-a867-a653b0ef192b tempest-CreateVolumesFromSnapshotTest-2135203075 None] Create snapshot completed successfully
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8561778-a4e2-474b-891c-9453f6fce3d7]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:18 devstack sudo[108800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2
Jun 16 18:54:18 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:18 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2" returned: 0 in 0.725s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:19 devstack sudo[108805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e 1G
Jun 16 18:54:19 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (57050fd0-a90a-416c-893a-811af1234f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fb2026-220b-4612-90f4-c4e421e2222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fb2026-220b-4612-90f4-c4e421e2222b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461365646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fcdad1-707e-4ef1-a17e-c23bbd76562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:19Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d632b0f-e960-4b4a-8ef2-763f8fe726c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d632b0f-e960-4b4a-8ef2-763f8fe726c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bb1dc9-671c-40f9-bd76-c4755641ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bb1dc9-671c-40f9-bd76-c4755641ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9fcdad1-707e-4ef1-a17e-c23bbd76562d', 'volume_name': 'volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e8ad1b-0fae-455a-8339-00e230524290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e8ad1b-0fae-455a-8339-00e230524290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314af026-607b-4a0d-9bb2-924a0accbdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume c9fcdad1-707e-4ef1-a17e-c23bbd76562d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d', 'volume_size': 1}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (3e461efc-10d7-418c-9df0-5275d4cc5a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca512642-2339-49c7-80f3-bf51546d7096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca512642-2339-49c7-80f3-bf51546d7096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1812574781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee882d2f-0086-49f6-be01-ed28e5401417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:19Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0609312b-b799-4a7a-892c-fa5ce715558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0609312b-b799-4a7a-892c-fa5ce715558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845b48ab-395d-443b-bc6d-0a8069990786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845b48ab-395d-443b-bc6d-0a8069990786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee882d2f-0086-49f6-be01-ed28e5401417', 'volume_name': 'volume-ee882d2f-0086-49f6-be01-ed28e5401417', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e61b78-0a38-4685-bc4d-750f532d6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e61b78-0a38-4685-bc4d-750f532d6033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeefdae8-8197-4b77-83d9-4338ee7a690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume ee882d2f-0086-49f6-be01-ed28e5401417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee882d2f-0086-49f6-be01-ed28e5401417', 'volume_size': 1}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:19 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e 1G" returned: 0 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:19 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e
Jun 16 18:54:19 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (f48674e5-f13c-470f-8e9d-27092a6df824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eccfee2-4ea4-48de-bb71-22b8cadf1a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eccfee2-4ea4-48de-bb71-22b8cadf1a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133344923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f5114a-21cf-4303-868f-427822460c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:20Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f7210e-0cdb-4188-9ef5-b8a516311f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f7210e-0cdb-4188-9ef5-b8a516311f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e3bd34-e6dc-433e-ab79-e74d0d78d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e3bd34-e6dc-433e-ab79-e74d0d78d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f5114a-21cf-4303-868f-427822460c40', 'volume_name': 'volume-f5f5114a-21cf-4303-868f-427822460c40', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66732dbe-9272-4cc8-9be2-61ef48cd16e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66732dbe-9272-4cc8-9be2-61ef48cd16e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830c4748-a978-4973-8eab-9f881f5b5b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume f5f5114a-21cf-4303-868f-427822460c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f5114a-21cf-4303-868f-427822460c40', 'volume_size': 1}
Jun 16 18:54:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (87480183-6071-45db-b64f-a5dd680c0f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e4102-557c-4a2e-979f-2958d614753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e4102-557c-4a2e-979f-2958d614753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863090459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d4fc36-cd2b-4794-86eb-b67f99fef0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:20Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce26921-a58a-425d-9989-70fa26d39633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce26921-a58a-425d-9989-70fa26d39633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9914d8c-f76b-42a3-b8ac-e5f128b4b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9914d8c-f76b-42a3-b8ac-e5f128b4b73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d4fc36-cd2b-4794-86eb-b67f99fef0c0', 'volume_name': 'volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c330f9c9-470c-4606-be75-9afcf6dbf17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c330f9c9-470c-4606-be75-9afcf6dbf17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7b4ed3-c39a-47b5-b020-802f1de93026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume 33d4fc36-cd2b-4794-86eb-b67f99fef0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0', 'volume_size': 1}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:20 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:20 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e is being set with open permissions: ugo+rw
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:20 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e
Jun 16 18:54:20 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (c4fc1d1c-cb90-4a87-b1c3-9b9000a533dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097baf52-75a5-4488-b0da-35f209e9288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097baf52-75a5-4488-b0da-35f209e9288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1154138879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953b18bb-3081-4b23-9983-948a2dcf11d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:20Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34724447-53f0-464d-9552-63445dd8cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34724447-53f0-464d-9552-63445dd8cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06b3504-05de-4d60-8790-99fbb345370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06b3504-05de-4d60-8790-99fbb345370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953b18bb-3081-4b23-9983-948a2dcf11d3', 'volume_name': 'volume-953b18bb-3081-4b23-9983-948a2dcf11d3', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3cc7d3-98dd-4ff2-8df8-c0cc5405b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3cc7d3-98dd-4ff2-8df8-c0cc5405b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5eff0e7-5d67-487c-b80c-c362fa3bf049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:20 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume 953b18bb-3081-4b23-9983-948a2dcf11d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953b18bb-3081-4b23-9983-948a2dcf11d3', 'volume_size': 1}
Jun 16 18:54:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:21 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e" returned: 0 in 0.611s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:21 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info
Jun 16 18:54:21 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:21 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info" returned: 0 in 0.589s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:21 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info is being set with open permissions: ugo+rw
Jun 16 18:54:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:21 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info
Jun 16 18:54:21 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:22 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.info" returned: 0 in 0.563s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.093s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.041s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461365646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fcdad1-707e-4ef1-a17e-c23bbd76562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:19Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating volume c9fcdad1-707e-4ef1-a17e-c23bbd76562d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:22 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:22 devstack sudo[108833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d 1073741824
Jun 16 18:54:22 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2b88464c-31a6-48d3-9c8d-3fb5e135a94a tempest-VolumesSnapshotTestJSON-902116570 None] Create snapshot completed successfully
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-66c2416d-f30b-49d4-906d-d629823c4a9e-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-66c2416d-f30b-49d4-906d-d629823c4a9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-4f329b79-a53d-4bae-bd16-cf717d8be6c2" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-4f329b79-a53d-4bae-bd16-cf717d8be6c2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-66c2416d-f30b-49d4-906d-d629823c4a9e" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-66c2416d-f30b-49d4-906d-d629823c4a9e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Deleting offline snapshot 66c2416d-f30b-49d4-906d-d629823c4a9e of volume 4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] snapshot_file for this snap is: volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef6b29-de6c-46ab-9fc8-ad05875fecbf]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:23 devstack sudo[108838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e
Jun 16 18:54:23 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:23 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d 1073741824" returned: 0 in 0.822s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:23 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d
Jun 16 18:54:23 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:23 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb0a9c-261c-4975-a16b-5b2c751fc8e2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:23 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1812574781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee882d2f-0086-49f6-be01-ed28e5401417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:19Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating volume ee882d2f-0086-49f6-be01-ed28e5401417 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:23 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:23 devstack sudo[108847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2
Jun 16 18:54:23 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:23 devstack sudo[108848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417 1073741824
Jun 16 18:54:23 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314af026-607b-4a0d-9bb2-924a0accbdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db20c164-5e48-4128-a61a-b8cd95d5d4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:23 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d (c9fcdad1-707e-4ef1-a17e-c23bbd76562d): created successfully
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db20c164-5e48-4128-a61a-b8cd95d5d4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:23 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (57050fd0-a90a-416c-893a-811af1234f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-79cbb0db-db3b-4086-9594-1d9b18f4e6cb tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created volume successfully.
Jun 16 18:54:24 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2" returned: 0 in 0.739s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:24 devstack sudo[108858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e
Jun 16 18:54:24 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:24 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417 1073741824" returned: 0 in 0.772s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:24 devstack sudo[108860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417
Jun 16 18:54:24 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:25 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e" returned: 0 in 0.676s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:25 devstack sudo[108866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e
Jun 16 18:54:25 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:25 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417" returned: 0 in 0.619s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.280s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133344923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f5114a-21cf-4303-868f-427822460c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:20Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating volume f5f5114a-21cf-4303-868f-427822460c40 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:25 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeefdae8-8197-4b77-83d9-4338ee7a690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee882d2f-0086-49f6-be01-ed28e5401417', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039649f7-9c63-4b55-afc2-5a79652a30e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:25 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40 1073741824
Jun 16 18:54:25 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:25 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume volume-ee882d2f-0086-49f6-be01-ed28e5401417 (ee882d2f-0086-49f6-be01-ed28e5401417): created successfully
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039649f7-9c63-4b55-afc2-5a79652a30e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (3e461efc-10d7-418c-9df0-5275d4cc5a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6b400fca-14d3-4818-a27b-8547cedea39f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created volume successfully.
Jun 16 18:54:25 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2.66c2416d-f30b-49d4-906d-d629823c4a9e" returned: 0 in 0.612s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-66c2416d-f30b-49d4-906d-d629823c4a9e" released by "_delete_snapshot" :: held 2.846s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-4f329b79-a53d-4bae-bd16-cf717d8be6c2" released by "delete_snapshot" :: held 2.871s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['2111a005-2df7-4993-b7e2-fd43b7cf6d65', '067a4ddf-5daa-4895-bff2-7477e5b857e0', '491edb64-6f06-4642-939a-4c06ad409b44', 'ac5c1cda-5a77-4214-a69e-7b6ea066d78c'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Delete snapshot completed successfully.
Jun 16 18:54:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f8e9ebc1-2d92-4816-b8fc-b943dcbb2b27 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-66c2416d-f30b-49d4-906d-d629823c4a9e-delete_snapshot" released by "delete_snapshot" :: held 3.047s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:26 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40 1073741824" returned: 0 in 0.846s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:26 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40
Jun 16 18:54:26 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (e23b89a7-5b5f-408e-a134-533b0111c21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ccd662-e0a5-4c23-b1fe-b4c973d53097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ccd662-e0a5-4c23-b1fe-b4c973d53097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-801434387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d27a24c-6157-4072-be6a-f3da021903f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:26Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482f16bf-7390-4827-abed-d1cf6e3043fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482f16bf-7390-4827-abed-d1cf6e3043fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1e4830-8181-4843-bb83-78e371e6f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1e4830-8181-4843-bb83-78e371e6f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d27a24c-6157-4072-be6a-f3da021903f7', 'volume_name': 'volume-1d27a24c-6157-4072-be6a-f3da021903f7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7472b5-35af-4ea4-80d9-4eeae4ec8d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7472b5-35af-4ea4-80d9-4eeae4ec8d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c958f1b-3fee-40fd-bc3c-7a23c8ebfd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:26 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Volume 1d27a24c-6157-4072-be6a-f3da021903f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d27a24c-6157-4072-be6a-f3da021903f7', 'volume_size': 1}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:26 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.439s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863090459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d4fc36-cd2b-4794-86eb-b67f99fef0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:20Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating volume 33d4fc36-cd2b-4794-86eb-b67f99fef0c0 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:26 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830c4748-a978-4973-8eab-9f881f5b5b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f5114a-21cf-4303-868f-427822460c40', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:26 devstack sudo[108878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 1073741824
Jun 16 18:54:26 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76629b0c-9859-4fa4-b144-fac4688f46a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:26 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume volume-f5f5114a-21cf-4303-868f-427822460c40 (f5f5114a-21cf-4303-868f-427822460c40): created successfully
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76629b0c-9859-4fa4-b144-fac4688f46a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:26 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (f48674e5-f13c-470f-8e9d-27092a6df824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:26 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ed349940-bdf9-4563-a61d-2d20d5e2c32c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created volume successfully.
Jun 16 18:54:27 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 1073741824" returned: 0 in 0.763s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:27 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0
Jun 16 18:54:27 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:28 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0" returned: 0 in 0.603s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.512s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1154138879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953b18bb-3081-4b23-9983-948a2dcf11d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819004ad99c74ae7aa96d47fc4a295a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:20Z,use_quota=True,user_id='d5eae5eaf0254da09c5e8a6c6a1d9d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Creating volume 953b18bb-3081-4b23-9983-948a2dcf11d3 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:28 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7b4ed3-c39a-47b5-b020-802f1de93026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:28 devstack sudo[108886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3 1073741824
Jun 16 18:54:28 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fce31b5-5907-4491-bc7f-1a39e9b82c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:28 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 (33d4fc36-cd2b-4794-86eb-b67f99fef0c0): created successfully
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fce31b5-5907-4491-bc7f-1a39e9b82c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (87480183-6071-45db-b64f-a5dd680c0f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:28 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-419d3f72-2a89-4870-b1c8-058fcae11b1f tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created volume successfully.
Jun 16 18:54:28 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3 1073741824" returned: 0 in 0.762s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:28 devstack sudo[108891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3
Jun 16 18:54:28 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:29 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.951s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-801434387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d27a24c-6157-4072-be6a-f3da021903f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:26Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Creating volume 1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:29 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5eff0e7-5d67-487c-b80c-c362fa3bf049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953b18bb-3081-4b23-9983-948a2dcf11d3', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:29 devstack sudo[108894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 1073741824
Jun 16 18:54:29 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b43fd2-3620-4ea7-b414-bd4d3f71e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:29 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Volume volume-953b18bb-3081-4b23-9983-948a2dcf11d3 (953b18bb-3081-4b23-9983-948a2dcf11d3): created successfully
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b43fd2-3620-4ea7-b414-bd4d3f71e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Flow 'volume_create_manager' (c4fc1d1c-cb90-4a87-b1c3-9b9000a533dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-daa7bdc8-1ea9-493c-b765-07f58654e340 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created volume successfully.
Jun 16 18:54:30 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-953b18bb-3081-4b23-9983-948a2dcf11d3-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 1073741824" returned: 0 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-953b18bb-3081-4b23-9983-948a2dcf11d3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-953b18bb-3081-4b23-9983-948a2dcf11d3" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-953b18bb-3081-4b23-9983-948a2dcf11d3" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:30 devstack sudo[108901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:30 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca3196-5856-4874-a631-a372e8705ef1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:30 devstack sudo[108903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3
Jun 16 18:54:30 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:31 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.665s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c958f1b-3fee-40fd-bc3c-7a23c8ebfd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d27a24c-6157-4072-be6a-f3da021903f7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dac510-e54a-46ce-8ae8-bd8902c1f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:31 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Volume volume-1d27a24c-6157-4072-be6a-f3da021903f7 (1d27a24c-6157-4072-be6a-f3da021903f7): created successfully
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dac510-e54a-46ce-8ae8-bd8902c1f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (e23b89a7-5b5f-408e-a134-533b0111c21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:31 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f3f00908-6568-478d-98ed-1e01b065735b tempest-VolumesSnapshotTestJSON-902116570 None] Created volume successfully.
Jun 16 18:54:31 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3" returned: 0 in 0.699s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:31 devstack sudo[108945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3
Jun 16 18:54:31 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:31 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-953b18bb-3081-4b23-9983-948a2dcf11d3" returned: 0 in 0.573s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-953b18bb-3081-4b23-9983-948a2dcf11d3" released by "delete_volume" :: held 1.317s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['ef6ba457-b989-4f46-b82c-1ac105d8d7cd', '969870fe-b4e1-4bc5-ae56-b428d657d76f', 'a12cbfce-19e4-439e-b24c-aa3cbc749750', '54e6bba3-90e4-48f0-8051-c1dfccfdd7a1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:31 devstack sudo[108948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:31 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Creating offline snapshot 3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 of volume 1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ddd2b-59cc-47e0-9d9c-bae1ed494263]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:32 devstack sudo[108950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:32 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:32 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:32 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleted volume successfully.
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6c4cbb50-1b60-4693-a2ec-1b7eb1157703 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-953b18bb-3081-4b23-9983-948a2dcf11d3-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-33d4fc36-cd2b-4794-86eb-b67f99fef0c0-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-33d4fc36-cd2b-4794-86eb-b67f99fef0c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-33d4fc36-cd2b-4794-86eb-b67f99fef0c0" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-33d4fc36-cd2b-4794-86eb-b67f99fef0c0" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5730cb-a729-4130-8b76-fb833e3ba8f6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:32 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:32 devstack sudo[108957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 1G
Jun 16 18:54:32 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:32 devstack sudo[108956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0
Jun 16 18:54:32 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:33 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0" returned: 0 in 0.689s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:33 devstack sudo[108966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0
Jun 16 18:54:33 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:33 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 1G" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d27a24c-6157-4072-be6a-f3da021903f7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:33 devstack sudo[108968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d27a24c-6157-4072-be6a-f3da021903f7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7
Jun 16 18:54:33 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:33 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-33d4fc36-cd2b-4794-86eb-b67f99fef0c0" returned: 0 in 0.608s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-33d4fc36-cd2b-4794-86eb-b67f99fef0c0" released by "delete_volume" :: held 1.337s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['534cd924-23a9-43da-bfe8-b280d9c3411f', '23792477-a601-488a-a653-bc064e97cbc9', 'd5ab633c-c6f7-4882-bfd9-22793a86989c', '2a29206f-7055-401c-adbb-95578a6d7924'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:34 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d27a24c-6157-4072-be6a-f3da021903f7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" returned: 0 in 0.640s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:34 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 is being set with open permissions: ugo+rw
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:34 devstack sudo[108974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:34 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:34 devstack sudo[108975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7
Jun 16 18:54:34 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:34 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:34 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" returned: 0 in 0.584s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.599s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleted volume successfully.
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9f48b9d4-9594-445a-8f93-afe6bd5d2acf tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-33d4fc36-cd2b-4794-86eb-b67f99fef0c0-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:34 devstack sudo[108981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info
Jun 16 18:54:34 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-f5f5114a-21cf-4303-868f-427822460c40-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-f5f5114a-21cf-4303-868f-427822460c40-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-f5f5114a-21cf-4303-868f-427822460c40" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-f5f5114a-21cf-4303-868f-427822460c40" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0290f4-66ce-40f9-b82b-b7d75ef2cccf]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:34 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40
Jun 16 18:54:34 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:35 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:35 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info is being set with open permissions: ugo+rw
Jun 16 18:54:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:35 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info
Jun 16 18:54:35 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:35 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40" returned: 0 in 0.720s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:35 devstack sudo[108991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40
Jun 16 18:54:35 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:35 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.info" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.033s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-33d06768-3e4b-41d5-95f2-43990497aa7c tempest-VolumesSnapshotTestJSON-902116570 None] Create snapshot completed successfully
Jun 16 18:54:36 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f5f5114a-21cf-4303-868f-427822460c40" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-f5f5114a-21cf-4303-868f-427822460c40" released by "delete_volume" :: held 1.405s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['35adeead-c4cd-4c05-b801-5dd7735438ed', 'e0ccd4c3-574e-4c49-a83c-ae3ff55c2891', 'f086c8f1-ac8b-479f-b6db-7f006b37bfa6', 'c7aad2e7-bb83-4f07-82ce-331aff028e44'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:36 devstack sudo[108995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:36 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (a0c0109c-4d1f-4b35-9358-684a045541c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff4e91b-8b7d-4a32-b2a7-a572a3c7b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff4e91b-8b7d-4a32-b2a7-a572a3c7b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1229290671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117ff2f6-1a0f-471b-829b-a280548c0679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:36Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d914c59-a44f-4d35-9661-668140347021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d914c59-a44f-4d35-9661-668140347021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb69cac2-5acd-4544-8c29-743127ef354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb69cac2-5acd-4544-8c29-743127ef354f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '117ff2f6-1a0f-471b-829b-a280548c0679', 'volume_name': 'volume-117ff2f6-1a0f-471b-829b-a280548c0679', 'volume_size': 2, 'snapshot_id': '3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e892b33-5842-48b0-9b9e-326f8e870df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e892b33-5842-48b0-9b9e-326f8e870df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943464c3-29b9-436a-a85a-82effef2ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:36 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Volume 117ff2f6-1a0f-471b-829b-a280548c0679: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-117ff2f6-1a0f-471b-829b-a280548c0679', 'volume_size': 2, 'snapshot_id': '3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7'}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7-117ff2f6-1a0f-471b-829b-a280548c0679" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7-117ff2f6-1a0f-471b-829b-a280548c0679" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Creating volume 117ff2f6-1a0f-471b-829b-a280548c0679 from snapshot 3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-117ff2f6-1a0f-471b-829b-a280548c0679" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-117ff2f6-1a0f-471b-829b-a280548c0679" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] snapshot: 3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7, volume: 117ff2f6-1a0f-471b-829b-a280548c0679,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6bc02-a8d8-477e-b4ed-ef4b90176173]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:36 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7
Jun 16 18:54:36 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-ee882d2f-0086-49f6-be01-ed28e5401417-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:37 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.635s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleted volume successfully.
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-ee882d2f-0086-49f6-be01-ed28e5401417-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b97166f5-156c-4549-8600-3c53fd014750 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-f5f5114a-21cf-4303-868f-427822460c40-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-ee882d2f-0086-49f6-be01-ed28e5401417" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-ee882d2f-0086-49f6-be01-ed28e5401417" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[98516679-9bbd-4f8a-ab6d-cd49efcd51c6]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:37 devstack sudo[109000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417
Jun 16 18:54:37 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:37 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d27a24c-6157-4072-be6a-f3da021903f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[95257a55-daff-48f1-8b1b-eb30dd4b85f9]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:37 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:37 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:37 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417" returned: 0 in 0.723s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:37 devstack sudo[109012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417
Jun 16 18:54:37 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:38 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.722s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:38 devstack sudo[109017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679
Jun 16 18:54:38 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:38 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ee882d2f-0086-49f6-be01-ed28e5401417" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-ee882d2f-0086-49f6-be01-ed28e5401417" released by "delete_volume" :: held 1.375s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['761bf572-dc75-47dd-a2e9-c72f73be7baa', 'd60b19b1-7432-4057-8bcf-6fe48f9b5e0e', '9dc68dd7-7be9-4897-98b8-8b840a746746', '45434970-cae0-451e-8109-9e5e37ac2d01'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:38 devstack sudo[109020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:38 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-c9fcdad1-707e-4ef1-a17e-c23bbd76562d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-c9fcdad1-707e-4ef1-a17e-c23bbd76562d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-c9fcdad1-707e-4ef1-a17e-c23bbd76562d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-c9fcdad1-707e-4ef1-a17e-c23bbd76562d" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[288386d0-0c6c-40c5-95e2-a330893d8e34]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:39 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.258s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleted volume successfully.
Jun 16 18:54:39 devstack sudo[109034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d
Jun 16 18:54:39 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:39 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-21aae87b-bf66-4a65-8205-85585421726c tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-ee882d2f-0086-49f6-be01-ed28e5401417-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:40 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d" returned: 0 in 1.431s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:41 devstack sudo[109040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d
Jun 16 18:54:41 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:42 devstack sudo[109043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:42 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:42 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-c9fcdad1-707e-4ef1-a17e-c23bbd76562d" returned: 0 in 1.486s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-c9fcdad1-707e-4ef1-a17e-c23bbd76562d" released by "delete_volume" :: held 3.031s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['59a658a3-71e5-494b-9c0d-643bdd7dd481', '1ecedae7-2ed6-4a0b-bd47-66c269ee0945', '88e1b2e1-477b-4f3a-9ccc-4dcf07cd1229', '8927c2ac-0b8c-4f3d-bc26-f255f66fb36c'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:42 devstack sudo[109045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:42 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:42 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-4099ced6-ab13-44fc-b531-1df2ee42cc77-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-4099ced6-ab13-44fc-b531-1df2ee42cc77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-ebc8d080-584a-4328-89c9-451621e88c20" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-ebc8d080-584a-4328-89c9-451621e88c20" acquired by "delete_snapshot" :: waited 0.037s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-4099ced6-ab13-44fc-b531-1df2ee42cc77" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-4099ced6-ab13-44fc-b531-1df2ee42cc77" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleting offline snapshot 4099ced6-ab13-44fc-b531-1df2ee42cc77 of volume ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] snapshot_file for this snap is: volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[987164de-9da9-4e76-9598-b3736be63233]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:43 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77
Jun 16 18:54:43 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:43 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.432s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:54:43 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679" returned: 0 in 5.346s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc788218-36d4-4a72-9483-69172cb4d49d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:43 devstack sudo[109050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:43 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:43 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.979s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleted volume successfully.
Jun 16 18:54:43 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-067ca828-12f3-45cd-ad0d-06458a1623c6 tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-c9fcdad1-707e-4ef1-a17e-c23bbd76562d-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:44 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77" returned: 0 in 0.860s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebc8d080-584a-4328-89c9-451621e88c20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532ae65-6369-46b2-9efa-a67b7f7a5600]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:44 devstack sudo[109056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20
Jun 16 18:54:44 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:44 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.879s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:54:44 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Converted 1024.00 MB image at 191.48 MB/s
Jun 16 18:54:44 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 is being set with open permissions: ugo+rw
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:44 devstack sudo[109061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679
Jun 16 18:54:44 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:44 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:44 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77
Jun 16 18:54:44 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:45 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-117ff2f6-1a0f-471b-829b-a280548c0679" released by "_copy_volume_from_snapshot" :: held 8.440s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7-117ff2f6-1a0f-471b-829b-a280548c0679" released by "_create_volume_from_snapshot" :: held 8.474s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.491s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943464c3-29b9-436a-a85a-82effef2ff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117ff2f6-1a0f-471b-829b-a280548c0679', 'volume_size': 2, 'snapshot_id': '3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5c7650-f538-44b7-948b-b08ba32f7ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:45 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Volume volume-117ff2f6-1a0f-471b-829b-a280548c0679 (117ff2f6-1a0f-471b-829b-a280548c0679): created successfully
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5c7650-f538-44b7-948b-b08ba32f7ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (a0c0109c-4d1f-4b35-9358-684a045541c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:45 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6a98ee97-478f-4dc3-8e79-1c0e4a0cffd1 tempest-VolumesSnapshotTestJSON-902116570 None] Created volume successfully.
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-117ff2f6-1a0f-471b-829b-a280548c0679-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-117ff2f6-1a0f-471b-829b-a280548c0679-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-117ff2f6-1a0f-471b-829b-a280548c0679" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-117ff2f6-1a0f-471b-829b-a280548c0679" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dffe9a-663e-4554-a106-2e2e5713bcc5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:45 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77" returned: 0 in 0.695s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:45 devstack sudo[109074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77
Jun 16 18:54:45 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:45 devstack sudo[109073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679
Jun 16 18:54:45 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:46 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20.4099ced6-ab13-44fc-b531-1df2ee42cc77" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-4099ced6-ab13-44fc-b531-1df2ee42cc77" released by "_delete_snapshot" :: held 3.039s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:46 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-ebc8d080-584a-4328-89c9-451621e88c20" released by "delete_snapshot" :: held 3.096s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:46 devstack sudo[109081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679
Jun 16 18:54:46 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['d114e487-37d7-46c4-83f8-96af9845371c', '845c4f44-d48f-4ebc-93d0-cbd3d98b86fb', '65c44445-db53-4770-8f70-7f5014829b89', 'b438240e-078a-4edd-9a99-fd48296435dc'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Delete snapshot completed successfully.
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a6e129e7-5c2f-40e8-912b-10dc308adafe tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-4099ced6-ab13-44fc-b531-1df2ee42cc77-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:46 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-117ff2f6-1a0f-471b-829b-a280548c0679" returned: 0 in 0.609s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-117ff2f6-1a0f-471b-829b-a280548c0679" released by "delete_volume" :: held 1.363s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['320a65f2-067c-47e3-8e5f-a551dd9868e2', '6a1ff4af-4805-4750-8774-608c131032eb', 'e4fdb1af-28a3-4555-9757-45bfae53e49c', '52859ff8-bdab-45d2-88c6-e302b40f0d4b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:46 devstack sudo[109084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:46 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-ebc8d080-584a-4328-89c9-451621e88c20-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-ebc8d080-584a-4328-89c9-451621e88c20-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "cinder-quobyte-ebc8d080-584a-4328-89c9-451621e88c20" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-ebc8d080-584a-4328-89c9-451621e88c20" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e8eb2-6f4a-47ab-a044-b48ef185b7b2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:47 devstack sudo[109087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20
Jun 16 18:54:47 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:47 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:47 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Deleted volume successfully.
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5b882337-47dc-41ca-a195-dfa83bc32e9f tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-117ff2f6-1a0f-471b-829b-a280548c0679-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-1d27a24c-6157-4072-be6a-f3da021903f7" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-1d27a24c-6157-4072-be6a-f3da021903f7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Deleting offline snapshot 3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 of volume 1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] snapshot_file for this snap is: volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3387f7-d022-4f02-afc5-ac27a85b0c7a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:47 devstack sudo[109089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7
Jun 16 18:54:47 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:48 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20" returned: 0 in 0.734s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:48 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20
Jun 16 18:54:48 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:48 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" returned: 0 in 0.703s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d27a24c-6157-4072-be6a-f3da021903f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5250e1-b4c3-45b3-af37-479c5a4c8153]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:48 devstack sudo[109099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:48 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:48 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-ebc8d080-584a-4328-89c9-451621e88c20" returned: 0 in 0.605s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-quobyte-ebc8d080-584a-4328-89c9-451621e88c20" released by "delete_volume" :: held 1.398s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Created reservations ['f809d500-f19e-4c2c-bc4b-8c8fc3e2e13e', '16fb6500-2e4c-4f2c-b838-51decb240064', '27b1bcb8-71e2-4b14-a060-c5beba0665ae', '4e2b04a5-d081-45d3-90cc-e43746c85f76'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:48 devstack sudo[109102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:48 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:49 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.712s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:49 devstack sudo[109107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7
Jun 16 18:54:49 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:49 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.597s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:49 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Deleted volume successfully.
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8e5d7040-5a8d-4b75-b74d-80df0fc4725d tempest-CreateVolumesFromSnapshotTest-2135203075 None] Lock "cinder-ebc8d080-584a-4328-89c9-451621e88c20-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:49 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" returned: 0 in 0.732s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:49 devstack sudo[109114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7
Jun 16 18:54:49 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:50 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7.3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" returned: 0 in 0.639s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7" released by "_delete_snapshot" :: held 2.891s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-1d27a24c-6157-4072-be6a-f3da021903f7" released by "delete_snapshot" :: held 2.919s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['5c4b3dd7-d425-4d13-bbf3-236fd0f666b9', 'bd5766bb-c8ec-4ef7-a5ff-c0536d060c1d', '9eb3a5e5-4df7-4941-9f31-12a843247d10', 'ccfff217-6ef2-45d7-9749-9e29c05de2d1'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Delete snapshot completed successfully.
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-841379d0-413f-4e8e-bddc-90c7ee342cac tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-3a36c1dc-5fa1-4130-aefe-d5ce16c97aa7-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-1d27a24c-6157-4072-be6a-f3da021903f7-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-1d27a24c-6157-4072-be6a-f3da021903f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-1d27a24c-6157-4072-be6a-f3da021903f7" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:54:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-1d27a24c-6157-4072-be6a-f3da021903f7" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:54:51 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122cc5b-6fee-433a-9ab1-11549a4b4460]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:51 devstack sudo[109118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:51 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:51 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.738s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:51 devstack sudo[109123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7
Jun 16 18:54:51 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Flow 'volume_create_manager' (d11f21f9-bfce-4b6e-a727-7c531d7ea23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d5f985-f4f3-471f-884f-d800f3dce3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:52 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d5f985-f4f3-471f-884f-d800f3dce3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809326873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533e447c-ed47-4140-b6a4-cf20fd57d399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa777ce666242beb494127776e80854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:52Z,use_quota=True,user_id='0c929434fa8d4c29a34445dc5f6d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952c3782-aeba-4d4d-85fa-053d973dfc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952c3782-aeba-4d4d-85fa-053d973dfc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7223caa7-2286-4aa9-a39f-1b4d052d6eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7223caa7-2286-4aa9-a39f-1b4d052d6eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533e447c-ed47-4140-b6a4-cf20fd57d399', 'volume_name': 'volume-533e447c-ed47-4140-b6a4-cf20fd57d399', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a40ed6a-77d1-4d8f-9910-965cfa4043da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a40ed6a-77d1-4d8f-9910-965cfa4043da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fe4442-510a-4972-992a-2ef2c0b3c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:52 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Volume 533e447c-ed47-4140-b6a4-cf20fd57d399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533e447c-ed47-4140-b6a4-cf20fd57d399', 'volume_size': 1}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809326873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533e447c-ed47-4140-b6a4-cf20fd57d399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa777ce666242beb494127776e80854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:52Z,use_quota=True,user_id='0c929434fa8d4c29a34445dc5f6d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Creating volume 533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:52 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d27a24c-6157-4072-be6a-f3da021903f7" returned: 0 in 0.671s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:52 devstack sudo[109126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 1073741824
Jun 16 18:54:52 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-1d27a24c-6157-4072-be6a-f3da021903f7" released by "delete_volume" :: held 1.477s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['83ac120e-034b-498a-b263-057ec189ceb6', '6b6f56be-297c-4b5c-b6c6-9970a70e805d', '8b9ebac0-fb79-4631-91b4-c9ae5b7fa212', '8dc0e655-4dd0-4014-83c7-2fab563942b4'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:52 devstack sudo[109128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:54:52 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:53 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.593s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:54:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Deleted volume successfully.
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d666990a-c8a0-46e0-ac2f-c9c0c9c7e671 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-1d27a24c-6157-4072-be6a-f3da021903f7-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:54:53 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 1073741824" returned: 0 in 0.775s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:53 devstack sudo[109134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:54:53 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (24daacb7-6ce6-479f-a5ac-7b9e9cbcd040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458dad5c-1982-450e-b484-de1aba89ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458dad5c-1982-450e-b484-de1aba89ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1482363697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3d31b5-5c3b-4026-9796-276e32f06df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:54Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c7e568-c64a-406a-ac35-9a417a5865f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c7e568-c64a-406a-ac35-9a417a5865f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0743fe67-f97a-47b7-8454-6f2a22997722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0743fe67-f97a-47b7-8454-6f2a22997722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3d31b5-5c3b-4026-9796-276e32f06df7', 'volume_name': 'volume-cf3d31b5-5c3b-4026-9796-276e32f06df7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a812fd-53bd-4168-9692-0eb28bb7a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a812fd-53bd-4168-9692-0eb28bb7a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e2d971-49a0-46aa-af44-5919a4214b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:53 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Volume cf3d31b5-5c3b-4026-9796-276e32f06df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3d31b5-5c3b-4026-9796-276e32f06df7', 'volume_size': 1}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:53 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 0.591s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.160s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1482363697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3d31b5-5c3b-4026-9796-276e32f06df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:54:54Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Creating volume cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:54:53 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:53 devstack sudo[109137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 1073741824
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fe4442-510a-4972-992a-2ef2c0b3c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533e447c-ed47-4140-b6a4-cf20fd57d399', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:53 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da826ba8-6845-4426-b082-ebd9dd1f545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:53 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Volume volume-533e447c-ed47-4140-b6a4-cf20fd57d399 (533e447c-ed47-4140-b6a4-cf20fd57d399): created successfully
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da826ba8-6845-4426-b082-ebd9dd1f545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:53 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Flow 'volume_create_manager' (d11f21f9-bfce-4b6e-a727-7c531d7ea23d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:53 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4d3f39f4-7a5e-460b-8b49-e3b8cbad1c66 tempest-VolumeDependencyTests-1160274444 None] Created volume successfully.
Jun 16 18:54:54 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 1073741824" returned: 0 in 0.759s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:54 devstack sudo[109143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:54:54 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:55 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.586s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.576s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e2d971-49a0-46aa-af44-5919a4214b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3d31b5-5c3b-4026-9796-276e32f06df7', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55e4932-51f1-4409-803c-c2c68fcd6e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Creating offline snapshot 03c4e697-eea8-4d5d-bebe-30c0ec30f8cf of volume 533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:54:55 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Volume volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 (cf3d31b5-5c3b-4026-9796-276e32f06df7): created successfully
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55e4932-51f1-4409-803c-c2c68fcd6e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (24daacb7-6ce6-479f-a5ac-7b9e9cbcd040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00766f-1fe9-44c9-a242-e9845465a74b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-61ddc98b-e520-44d4-9759-2361f61f6b40 tempest-VolumesSnapshotTestJSON-902116570 None] Created volume successfully.
Jun 16 18:54:55 devstack sudo[109146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:54:55 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:54:55 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:56 devstack sudo[109151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf 1G
Jun 16 18:54:56 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:56 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf 1G" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533e447c-ed47-4140-b6a4-cf20fd57d399 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:56 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533e447c-ed47-4140-b6a4-cf20fd57d399 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf
Jun 16 18:54:56 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:57 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533e447c-ed47-4140-b6a4-cf20fd57d399 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:57 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf is being set with open permissions: ugo+rw
Jun 16 18:54:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:57 devstack sudo[109161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf
Jun 16 18:54:57 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:57 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" returned: 0 in 0.609s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:57 devstack sudo[109164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info
Jun 16 18:54:57 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:58 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info" returned: 0 in 0.624s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:58 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info is being set with open permissions: ugo+rw
Jun 16 18:54:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:58 devstack sudo[109168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info
Jun 16 18:54:58 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:59 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.info" returned: 0 in 0.576s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.941s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.311s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Creating offline snapshot b08e3111-ee30-4db6-9be7-5128c37b567d of volume cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a430128-6284-4fd1-a1b1-7990d57cc0ef]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b9811319-6224-48e1-b022-3b1df0fbb1b5 tempest-VolumeDependencyTests-1160274444 None] Create snapshot completed successfully
Jun 16 18:54:59 devstack sudo[109171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:54:59 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:54:59 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:54:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:54:59 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d 1G
Jun 16 18:54:59 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Flow 'volume_create_manager' (dcef091b-c6ed-4909-9a59-fe68da0b1808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc43c3a9-7b67-4532-82f2-eefbc96d68f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc43c3a9-7b67-4532-82f2-eefbc96d68f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-584268731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ea05f2-4167-42e9-8ffd-aa9264f44d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa777ce666242beb494127776e80854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03c4e697-eea8-4d5d-bebe-30c0ec30f8cf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:55:00Z,use_quota=True,user_id='0c929434fa8d4c29a34445dc5f6d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58a1555-162c-4304-b7bf-d3014eb82730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58a1555-162c-4304-b7bf-d3014eb82730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c39cd9-8fb6-45fe-a7b7-88320f839ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c39cd9-8fb6-45fe-a7b7-88320f839ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43ea05f2-4167-42e9-8ffd-aa9264f44d8f', 'volume_name': 'volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f', 'volume_size': 1, 'snapshot_id': '03c4e697-eea8-4d5d-bebe-30c0ec30f8cf'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6cd422-9b71-46f6-a7d8-cb6f0f549ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6cd422-9b71-46f6-a7d8-cb6f0f549ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31abfd0-fe86-43a9-a04e-a4bd182e997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Volume 43ea05f2-4167-42e9-8ffd-aa9264f44d8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f', 'volume_size': 1, 'snapshot_id': '03c4e697-eea8-4d5d-bebe-30c0ec30f8cf'}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:00 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d 1G" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:00 devstack sudo[109182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d
Jun 16 18:55:00 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:01 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d" returned: 0 in 0.628s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:01 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d is being set with open permissions: ugo+rw
Jun 16 18:55:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:01 devstack sudo[109191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d
Jun 16 18:55:01 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:01 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:01 devstack sudo[109194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info
Jun 16 18:55:01 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:02 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:02 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info is being set with open permissions: ugo+rw
Jun 16 18:55:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:02 devstack sudo[109197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info
Jun 16 18:55:02 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:03 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.info" returned: 0 in 0.594s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.965s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.754s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-quobyte-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Creating volume 43ea05f2-4167-42e9-8ffd-aa9264f44d8f from snapshot 03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-quobyte-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-06da8ff8-b936-4eeb-987d-3bc9c049e311 tempest-VolumesSnapshotTestJSON-902116570 None] Create snapshot completed successfully
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] snapshot: 03c4e697-eea8-4d5d-bebe-30c0ec30f8cf, volume: 43ea05f2-4167-42e9-8ffd-aa9264f44d8f,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee102d42-6781-43c5-8556-9d2a84303183]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:03 devstack sudo[109200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf
Jun 16 18:55:03 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:03 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" returned: 0 in 0.699s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533e447c-ed47-4140-b6a4-cf20fd57d399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6456f7ff-ba28-45ea-9946-ed27bdf24952]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:04 devstack sudo[109206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:55:04 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (6608b0c5-a66d-44b3-9b4d-49d08cc7b8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf5128d-4d81-4dcb-acf4-4b1c4c54145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf5128d-4d81-4dcb-acf4-4b1c4c54145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-439253188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b82b812808244b883d429aab05bcb15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b08e3111-ee30-4db6-9be7-5128c37b567d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:55:05Z,use_quota=True,user_id='2d3c2ce12d0b44488c55baac7bee1d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e826c3-d293-473c-ac03-d5af9e3930d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e826c3-d293-473c-ac03-d5af9e3930d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e8620e-5b07-491c-81f0-86786091f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e8620e-5b07-491c-81f0-86786091f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd', 'volume_name': 'volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd', 'volume_size': 1, 'snapshot_id': 'b08e3111-ee30-4db6-9be7-5128c37b567d'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129a14a6-1ee7-4791-a4f4-e97fdc7f189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129a14a6-1ee7-4791-a4f4-e97fdc7f189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a06af6-cda5-46b7-a174-0caa42d32207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:04 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Volume 9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd', 'volume_size': 1, 'snapshot_id': 'b08e3111-ee30-4db6-9be7-5128c37b567d'}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:04 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 0.731s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:55:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:04 devstack sudo[109212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f
Jun 16 18:55:04 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:09 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" returned: 0 in 4.423s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6d1ee8-92b7-4300-a523-6cdba8485edd]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:09 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:55:09 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:10 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 0.888s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:55:10 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Converted 1024.00 MB image at 231.47 MB/s
Jun 16 18:55:10 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f is being set with open permissions: ugo+rw
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:10 devstack sudo[109231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f
Jun 16 18:55:10 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:10 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" returned: 0 in 0.580s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" released by "_copy_volume_from_snapshot" :: held 7.399s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" released by "_create_volume_from_snapshot" :: held 7.428s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.458s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.950s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-b08e3111-ee30-4db6-9be7-5128c37b567d-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=120,cinder:SELECT=112,cinder:INSERT=33,cinder:DELETE=8 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-b08e3111-ee30-4db6-9be7-5128c37b567d-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Creating volume 9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd from snapshot b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31abfd0-fe86-43a9-a04e-a4bd182e997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f', 'volume_size': 1, 'snapshot_id': '03c4e697-eea8-4d5d-bebe-30c0ec30f8cf'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e39fded-a8b3-4131-95d2-949efd192af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] snapshot: b08e3111-ee30-4db6-9be7-5128c37b567d, volume: 9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:55:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Volume volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f (43ea05f2-4167-42e9-8ffd-aa9264f44d8f): created successfully
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e39fded-a8b3-4131-95d2-949efd192af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Flow 'volume_create_manager' (dcef091b-c6ed-4909-9a59-fe68da0b1808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5d2b81-4efb-4502-847e-d8dc8b899f5a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-aa03ec35-bba8-4b7d-86f2-0ec34990a080 tempest-VolumeDependencyTests-1160274444 None] Created volume successfully.
Jun 16 18:55:10 devstack sudo[109234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d
Jun 16 18:55:10 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-quobyte-533e447c-ed47-4140-b6a4-cf20fd57d399" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-533e447c-ed47-4140-b6a4-cf20fd57d399" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-quobyte-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Deleting offline snapshot 03c4e697-eea8-4d5d-bebe-30c0ec30f8cf of volume 533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] snapshot_file for this snap is: volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30228e7-96d8-4be4-82e2-36936575820a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:11 devstack sudo[109236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf
Jun 16 18:55:11 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:11 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3d31b5-5c3b-4026-9796-276e32f06df7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1be59-5f54-4bc6-b930-2d02078deff9]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:11 devstack sudo[109241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:55:11 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:11 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" returned: 0 in 0.708s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533e447c-ed47-4140-b6a4-cf20fd57d399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6abcaff-ee87-4408-85b4-a45d498243ff]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:12 devstack sudo[109246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:55:12 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:12 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.744s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:12 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:55:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:12 devstack sudo[109251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd
Jun 16 18:55:12 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:12 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 0.701s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:12 devstack sudo[109256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf
Jun 16 18:55:12 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:13 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" returned: 0 in 1.072s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:13 devstack sudo[109272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf
Jun 16 18:55:13 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:14 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399.03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" returned: 0 in 0.993s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:14 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=104,cinder:UPDATE=126,cinder:INSERT=26,cinder:DELETE=17 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:55:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf" released by "_delete_snapshot" :: held 3.637s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-533e447c-ed47-4140-b6a4-cf20fd57d399" released by "delete_snapshot" :: held 3.679s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:14 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Created reservations ['e640e7f9-5e50-474e-8534-386d13dbef68', '9bcc2ff3-e55c-4e57-80a1-1ed0ae4e4749', '5fac9463-8ea3-4308-9f78-092db1f5474b', 'd6ef8135-b06d-4d04-95cb-6cf3215c05b5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:15 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Delete snapshot completed successfully.
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-5e864547-fd0d-4557-b861-b5338bfd778a tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-03c4e697-eea8-4d5d-bebe-30c0ec30f8cf-delete_snapshot" released by "delete_snapshot" :: held 3.919s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-533e447c-ed47-4140-b6a4-cf20fd57d399-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-533e447c-ed47-4140-b6a4-cf20fd57d399-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-quobyte-533e447c-ed47-4140-b6a4-cf20fd57d399" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-533e447c-ed47-4140-b6a4-cf20fd57d399" acquired by "delete_volume" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[98339871-15e5-487b-8673-0c45f473a068]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:16 devstack sudo[109294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:55:16 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:17 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" returned: 0 in 5.043s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:17 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad881628-682d-4d0d-b79b-93e1909fc81c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:17 devstack sudo[109693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:55:17 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:17 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 1.537s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:17 devstack sudo[109698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399
Jun 16 18:55:17 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:18 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-533e447c-ed47-4140-b6a4-cf20fd57d399" returned: 0 in 0.589s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-533e447c-ed47-4140-b6a4-cf20fd57d399" released by "delete_volume" :: held 2.275s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Created reservations ['b964b35b-11cf-48ff-8571-30b1a4ed826a', '57fbc10b-46cb-447e-87c7-5bcea7045495', '2306f4ab-bd41-4826-82ae-0f29fcaff846', 'a79e1f84-3a53-49a9-9276-d217e8e2afab'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:18 devstack sudo[109704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:55:18 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:18 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.905s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:55:18 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Converted 1024.00 MB image at 203.01 MB/s
Jun 16 18:55:18 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd is being set with open permissions: ugo+rw
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:18 devstack sudo[109706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd
Jun 16 18:55:18 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:18 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.570s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:55:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Deleted volume successfully.
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-14d93189-f6be-4b81-97a0-f55946151ed7 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-533e447c-ed47-4140-b6a4-cf20fd57d399-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:18 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" returned: 0 in 0.591s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" released by "_copy_volume_from_snapshot" :: held 8.108s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-b08e3111-ee30-4db6-9be7-5128c37b567d-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" released by "_create_volume_from_snapshot" :: held 8.147s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.173s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a06af6-cda5-46b7-a174-0caa42d32207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd', 'volume_size': 1, 'snapshot_id': 'b08e3111-ee30-4db6-9be7-5128c37b567d'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ab208d-4130-4191-bdd6-e80f92c8ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:55:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Volume volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd (9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd): created successfully
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ab208d-4130-4191-bdd6-e80f92c8ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Flow 'volume_create_manager' (6608b0c5-a66d-44b3-9b4d-49d08cc7b8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:55:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b70da27c-22b6-44b2-a32e-e34ce6eba3c8 tempest-VolumesSnapshotTestJSON-902116570 None] Created volume successfully.
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-43ea05f2-4167-42e9-8ffd-aa9264f44d8f-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-43ea05f2-4167-42e9-8ffd-aa9264f44d8f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "cinder-quobyte-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87bdeea-3538-4d29-bb38-683d1ce524ab]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:19 devstack sudo[109710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f
Jun 16 18:55:19 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:19 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" returned: 0 in 0.689s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:19 devstack sudo[109715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f
Jun 16 18:55:19 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f234a3-09e2-464a-8bd0-e4d09c379d6a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:20 devstack sudo[109718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd
Jun 16 18:55:20 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:20 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-quobyte-43ea05f2-4167-42e9-8ffd-aa9264f44d8f" released by "delete_volume" :: held 1.334s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Created reservations ['68fb62d4-c71f-4872-a783-62afc831d6f5', 'e7110c45-226c-4873-95a2-731628fd81fa', 'f272bd5e-77eb-41a1-b815-d57bc1917352', 'ea23008f-a04a-411e-b645-82a8f73a3b16'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:20 devstack sudo[109721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:55:20 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:20 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" returned: 0 in 0.713s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:20 devstack sudo[109726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd
Jun 16 18:55:20 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:21 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.576s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:55:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Deleted volume successfully.
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f0cb80b2-6390-4f4c-882e-f5bb9b156665 tempest-VolumeDependencyTests-1160274444 None] Lock "cinder-43ea05f2-4167-42e9-8ffd-aa9264f44d8f-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:21 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" returned: 0 in 0.584s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd" released by "delete_volume" :: held 1.337s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['49fa208d-06c7-43c5-82d4-bd9b759729bb', 'bc19a5bf-994a-4219-84f2-f22f65de9830', '0e781ae0-8ac8-4536-88b3-2556b67de9b1', 'e48a6f2b-ca21-410e-8786-41d687b45578'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:21 devstack sudo[109736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:55:21 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:22 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.630s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:55:22 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Deleted volume successfully.
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59aefb30-a133-4e4d-9e99-27585d4c82fc tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-9277c4fa-4f39-4a42-ba29-deb3e8ad0cfd-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-b08e3111-ee30-4db6-9be7-5128c37b567d-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-b08e3111-ee30-4db6-9be7-5128c37b567d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-cf3d31b5-5c3b-4026-9796-276e32f06df7" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-cf3d31b5-5c3b-4026-9796-276e32f06df7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-b08e3111-ee30-4db6-9be7-5128c37b567d" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-b08e3111-ee30-4db6-9be7-5128c37b567d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Deleting offline snapshot b08e3111-ee30-4db6-9be7-5128c37b567d of volume cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] snapshot_file for this snap is: volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ecb3ad-4980-475d-afec-abff453dd154]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:22 devstack sudo[109739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d
Jun 16 18:55:22 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:22 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d" returned: 0 in 0.744s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3d31b5-5c3b-4026-9796-276e32f06df7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1593573-e876-4429-8c9d-9850eec9b3af]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:23 devstack sudo[109744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:55:23 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:23 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.671s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:23 devstack sudo[109749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d
Jun 16 18:55:23 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:24 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d" returned: 0 in 0.671s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:24 devstack sudo[109754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d
Jun 16 18:55:24 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:24 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7.b08e3111-ee30-4db6-9be7-5128c37b567d" returned: 0 in 0.580s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-b08e3111-ee30-4db6-9be7-5128c37b567d" released by "_delete_snapshot" :: held 2.760s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-cf3d31b5-5c3b-4026-9796-276e32f06df7" released by "delete_snapshot" :: held 2.779s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['5da24119-4f78-479e-8afa-22101422dbed', 'a1302fc0-ac2a-465a-98d6-ff9d481b5ecd', 'b7ccdcc9-d326-4e06-a592-a2a19dfab918', '3be1e898-c2d1-4677-b962-48ea9371ac9f'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Delete snapshot completed successfully.
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d6e20f26-6088-419d-920a-b77e095a014d tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-b08e3111-ee30-4db6-9be7-5128c37b567d-delete_snapshot" released by "delete_snapshot" :: held 2.901s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-cf3d31b5-5c3b-4026-9796-276e32f06df7-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-cf3d31b5-5c3b-4026-9796-276e32f06df7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-cf3d31b5-5c3b-4026-9796-276e32f06df7" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-cf3d31b5-5c3b-4026-9796-276e32f06df7" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[78412fb8-d496-4f31-a550-ae8454f5dd44]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:25 devstack sudo[109757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:55:25 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:26 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.676s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:26 devstack sudo[109762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7
Jun 16 18:55:26 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:26 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-cf3d31b5-5c3b-4026-9796-276e32f06df7" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-cf3d31b5-5c3b-4026-9796-276e32f06df7" released by "delete_volume" :: held 1.321s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['387b8a58-0cd9-41ef-beb4-78488524ae1c', '662be40d-6b13-4c6c-b193-892ec853ea3d', '7bda0a1b-d542-4af1-92d0-cc7e0964246e', 'bf43cc00-dd8a-4328-8b83-8c872cab574b'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:26 devstack sudo[109765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:55:26 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:27 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.568s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:55:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Deleted volume successfully.
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9a8e1d17-5a5b-4928-bd88-c09880872153 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-cf3d31b5-5c3b-4026-9796-276e32f06df7-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-4f329b79-a53d-4bae-bd16-cf717d8be6c2-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-4f329b79-a53d-4bae-bd16-cf717d8be6c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "cinder-quobyte-4f329b79-a53d-4bae-bd16-cf717d8be6c2" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-4f329b79-a53d-4bae-bd16-cf717d8be6c2" acquired by "delete_volume" :: waited 0.013s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf72e2b4-ad5c-4cc0-8293-aa673d191599]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:55:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:27 devstack sudo[109768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2
Jun 16 18:55:27 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:28 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2" returned: 0 in 0.682s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:28 devstack sudo[109773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2
Jun 16 18:55:28 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:29 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4f329b79-a53d-4bae-bd16-cf717d8be6c2" returned: 0 in 0.592s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-quobyte-4f329b79-a53d-4bae-bd16-cf717d8be6c2" released by "delete_volume" :: held 1.331s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Created reservations ['7482d3c3-5272-4fa1-a902-08c0c1fe3f22', 'b312e783-cca9-42f7-8b4a-4bac801e3c45', 'c6d57f14-e85b-4b68-92c5-f948b13aa06c', '4c15e107-3639-4773-a9a7-960c346ddd9d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:29 devstack sudo[109776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:55:29 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:29 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.577s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:55:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Deleted volume successfully.
Jun 16 18:55:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-2e90ef4e-1a37-4eb9-9302-97a8762dd785 tempest-VolumesSnapshotTestJSON-902116570 None] Lock "cinder-4f329b79-a53d-4bae-bd16-cf717d8be6c2-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:55:39 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=36,cinder:INSERT=16,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:55:39 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=52,cinder:SELECT=36,cinder:INSERT=12,cinder:DELETE=3 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:55:42 devstack sudo[109822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:55:42 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:55:42 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.628s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:55:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Flow 'volume_create_manager' (b24baf71-6ad1-4efa-aea1-0c1ecfc640d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdf70a8-7f01-405d-a562-9aa7bf451260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdf70a8-7f01-405d-a562-9aa7bf451260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-224789284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dac7d79-6136-47bc-b918-e33c3b8b3ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a3b9f0b7014910b7180cc72959d5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:56:11Z,use_quota=True,user_id='c94cc9ada0444d30b259f871a7c8f83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c4feca-41f5-43ca-8d7b-42d900a87c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c4feca-41f5-43ca-8d7b-42d900a87c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f86439-4427-417b-8cf7-29595a1dfc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f86439-4427-417b-8cf7-29595a1dfc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dac7d79-6136-47bc-b918-e33c3b8b3ae8', 'volume_name': 'volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ab92c4-feff-4b40-81e8-d85cd8e4f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ab92c4-feff-4b40-81e8-d85cd8e4f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86843d28-1a8b-45a4-8d8f-0a37eb3bb6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:56:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Volume 2dac7d79-6136-47bc-b918-e33c3b8b3ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8', 'volume_size': 1}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-224789284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dac7d79-6136-47bc-b918-e33c3b8b3ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a3b9f0b7014910b7180cc72959d5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:56:11Z,use_quota=True,user_id='c94cc9ada0444d30b259f871a7c8f83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Creating volume 2dac7d79-6136-47bc-b918-e33c3b8b3ae8 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:56:10 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:56:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:56:10 devstack sudo[109928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 1073741824
Jun 16 18:56:10 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:56:11 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root
Jun 16 18:56:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 1073741824" returned: 0 in 0.764s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:56:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:56:11 devstack sudo[109934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8
Jun 16 18:56:11 devstack sudo[109934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:56:12 devstack sudo[109934]: pam_unix(sudo:session): session closed for user root
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86843d28-1a8b-45a4-8d8f-0a37eb3bb6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9093396c-943d-4b39-9763-79919ec9c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:56:12 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Volume volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 (2dac7d79-6136-47bc-b918-e33c3b8b3ae8): created successfully
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9093396c-943d-4b39-9763-79919ec9c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:56:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Flow 'volume_create_manager' (b24baf71-6ad1-4efa-aea1-0c1ecfc640d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:56:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6f25c1bb-4d73-49d0-bd01-fa7a969006f5 tempest-TestMinimumBasicScenario-581701126 None] Created volume successfully.
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7205c8f0-66fa-4341-99cd-552b59e9e09c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:56:16 devstack sudo[109946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8
Jun 16 18:56:16 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:56:16 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:56:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04002402-5787-45e4-9fed-f9422b5e5da0', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:56:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-be84f75d-f961-4b40-aa6c-d0ee501f69df req-4453bc99-9d7e-4115-ae87-8cf2a404b4aa tempest-TestMinimumBasicScenario-581701126 None] attachment_update completed successfully.
Jun 16 18:56:26 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:56:26 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:56:42 devstack sudo[110536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:56:42 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:56:42 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.572s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:56:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:56:52 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:57:03 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-310544cb-1106-484d-b281-bcc94a2a6367 req-f3b3d764-c736-43dc-b626-b611313c1b2a tempest-TestMinimumBasicScenario-581701126 None] Terminate volume connection completed successfully.
Jun 16 18:57:03 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-310544cb-1106-484d-b281-bcc94a2a6367 req-f3b3d764-c736-43dc-b626-b611313c1b2a tempest-TestMinimumBasicScenario-581701126 None] Deleting attachment 04002402-5787-45e4-9fed-f9422b5e5da0. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:57:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Acquiring lock "cinder-2dac7d79-6136-47bc-b918-e33c3b8b3ae8-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:57:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Lock "cinder-2dac7d79-6136-47bc-b918-e33c3b8b3ae8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:57:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Acquiring lock "cinder-quobyte-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:57:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Lock "cinder-quobyte-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:57:05 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[086d4dbc-5d88-4f9d-b016-9fbc5ac58084]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:57:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:05 devstack sudo[110562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8
Jun 16 18:57:05 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:06 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" returned: 0 in 0.681s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:06 devstack sudo[110567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8
Jun 16 18:57:06 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:07 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Lock "cinder-quobyte-2dac7d79-6136-47bc-b918-e33c3b8b3ae8" released by "delete_volume" :: held 1.323s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Created reservations ['156a03d0-cb54-4139-845a-db65201a680d', '48f66e2c-fbef-47cd-97da-6af4e57b3bce', 'c29155d0-1b20-4781-8f06-44315061092e', '6fb47806-d182-45de-bd43-51beefcf42fd'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:07 devstack sudo[110570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:57:07 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:07 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.576s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:57:07 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Deleted volume successfully.
Jun 16 18:57:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-86109e31-d90c-4fc3-b800-231bc37f9235 tempest-TestMinimumBasicScenario-581701126 None] Lock "cinder-2dac7d79-6136-47bc-b918-e33c3b8b3ae8-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:57:17 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:57:17 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Flow 'volume_create_manager' (459380ea-d65d-4738-ba5f-f3e55403a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab092e3-3e99-479a-a4e4-8230bd97d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab092e3-3e99-479a-a4e4-8230bd97d116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1864011491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790af574-481a-4c17-b537-e49a061b2be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c40c96628f4b46a414fe2f1ed48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:57:41Z,use_quota=True,user_id='07599848e412476aba841d61dc33fb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935859d-3d45-44d8-9d4f-1d683b8f2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935859d-3d45-44d8-9d4f-1d683b8f2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1090c2-f18e-4fc0-8aab-7e3d0abb0d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1090c2-f18e-4fc0-8aab-7e3d0abb0d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790af574-481a-4c17-b537-e49a061b2be3', 'volume_name': 'volume-790af574-481a-4c17-b537-e49a061b2be3', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6d7b1f-fe3d-4397-b3ea-a99bdf3c5ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6d7b1f-fe3d-4397-b3ea-a99bdf3c5ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da5768e-f159-4480-bace-469c4d9e2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:40 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Volume 790af574-481a-4c17-b537-e49a061b2be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790af574-481a-4c17-b537-e49a061b2be3', 'volume_size': 1}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1864011491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790af574-481a-4c17-b537-e49a061b2be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c40c96628f4b46a414fe2f1ed48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:57:41Z,use_quota=True,user_id='07599848e412476aba841d61dc33fb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Creating volume 790af574-481a-4c17-b537-e49a061b2be3 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:57:40 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:57:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:40 devstack sudo[110669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 1073741824
Jun 16 18:57:40 devstack sudo[110669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Flow 'volume_create_manager' (8b2ea283-f129-4767-8554-a09a67ac62c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a949a5ed-645e-41c3-a6fe-09c6277a1f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a949a5ed-645e-41c3-a6fe-09c6277a1f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-894490703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a504ad-4d0e-469e-9dfc-dbdb9524811c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c40c96628f4b46a414fe2f1ed48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:57:41Z,use_quota=True,user_id='07599848e412476aba841d61dc33fb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2eaf0a-73aa-450e-9984-9173a22cd62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2eaf0a-73aa-450e-9984-9173a22cd62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29698b96-c120-4c66-9edc-6b26bbe99778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29698b96-c120-4c66-9edc-6b26bbe99778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a504ad-4d0e-469e-9dfc-dbdb9524811c', 'volume_name': 'volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf53aca0-6e95-49f2-a3b8-740570199c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf53aca0-6e95-49f2-a3b8-740570199c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87a9f9-0daf-4171-9818-9056d23e8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:41 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Volume 87a504ad-4d0e-469e-9dfc-dbdb9524811c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c', 'volume_size': 1}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:57:41 devstack sudo[110669]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 1073741824" returned: 0 in 0.808s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:41 devstack sudo[110674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3
Jun 16 18:57:41 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:42 devstack sudo[110676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:57:42 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:42 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3" returned: 0 in 0.582s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-894490703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a504ad-4d0e-469e-9dfc-dbdb9524811c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c40c96628f4b46a414fe2f1ed48426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:57:41Z,use_quota=True,user_id='07599848e412476aba841d61dc33fb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Creating volume 87a504ad-4d0e-469e-9dfc-dbdb9524811c {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:57:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da5768e-f159-4480-bace-469c4d9e2c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790af574-481a-4c17-b537-e49a061b2be3', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:42 devstack sudo[110679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c 1073741824
Jun 16 18:57:42 devstack sudo[110679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5476c9-9837-40a6-9ef9-473275454480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Volume volume-790af574-481a-4c17-b537-e49a061b2be3 (790af574-481a-4c17-b537-e49a061b2be3): created successfully
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5476c9-9837-40a6-9ef9-473275454480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Flow 'volume_create_manager' (459380ea-d65d-4738-ba5f-f3e55403a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:57:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-75378003-8a28-4283-a6e2-a5097ff99baa tempest-TestServerVolumeAttachmentScenario-1436798672 None] Created volume successfully.
Jun 16 18:57:42 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.623s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:57:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:57:43 devstack sudo[110679]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c 1073741824" returned: 0 in 0.814s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:57:43 devstack sudo[110686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c
Jun 16 18:57:43 devstack sudo[110686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:57:43 devstack sudo[110686]: pam_unix(sudo:session): session closed for user root
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c" returned: 0 in 0.628s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87a9f9-0daf-4171-9818-9056d23e8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d175dab-0c42-440f-a1f9-852633b16cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:57:43 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Volume volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c (87a504ad-4d0e-469e-9dfc-dbdb9524811c): created successfully
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d175dab-0c42-440f-a1f9-852633b16cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:57:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Flow 'volume_create_manager' (8b2ea283-f129-4767-8554-a09a67ac62c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:57:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-82e5be9c-31cb-4fbd-a081-858766a2c71d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Created volume successfully.
Jun 16 18:57:53 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:57:53 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:DELETE=2,cinder:INSERT=1 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b997e-2a5e-4e2e-940b-cc5ac48c2fed]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:22 devstack sudo[110824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3
Jun 16 18:58:22 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:22 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3" returned: 0 in 0.689s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.705s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:58:22 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-790af574-481a-4c17-b537-e49a061b2be3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f958296c-b627-49de-bb2f-e47d82077c86', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:58:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-cf3a2b9a-e0fb-4a8e-9837-f1c3be815ce5 req-8ad3c657-e802-4464-abc8-c7208df19d4d tempest-TestServerVolumeAttachmentScenario-1436798672 None] attachment_update completed successfully.
Jun 16 18:58:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:58:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:58:32 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e0c3b-f2da-45cb-a9db-5263f4fc858d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:58:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:32 devstack sudo[111257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c
Jun 16 18:58:32 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:33 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c" returned: 0 in 0.712s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.729s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:58:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798', 'name': 'volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fa2267b-a9cd-43f8-8e64-19a4425b55a0', 'enforce_multipath': True} {{(pid=91851) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}}
Jun 16 18:58:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-090a1698-1789-49f7-80b3-bebb840b8e39 req-6a134e44-41f9-44fc-958a-a0659d9f855f tempest-TestServerVolumeAttachmentScenario-1436798672 None] attachment_update completed successfully.
Jun 16 18:58:38 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-be0edf7c-d2e6-4f08-862c-cf7dd820ee0f req-768780fa-56cc-4958-9088-c72f307c687d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Terminate volume connection completed successfully.
Jun 16 18:58:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-be0edf7c-d2e6-4f08-862c-cf7dd820ee0f req-768780fa-56cc-4958-9088-c72f307c687d tempest-TestServerVolumeAttachmentScenario-1436798672 None] Deleting attachment 8fa2267b-a9cd-43f8-8e64-19a4425b55a0. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:42 devstack sudo[111271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:58:42 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:42 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.587s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:58:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [req-8f7e5032-2473-4204-b079-af50a1a88fe3 req-218a95a8-a821-49dc-b1e8-8503f55141a2 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Terminate volume connection completed successfully.
Jun 16 18:58:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [req-8f7e5032-2473-4204-b079-af50a1a88fe3 req-218a95a8-a821-49dc-b1e8-8503f55141a2 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Deleting attachment f958296c-b627-49de-bb2f-e47d82077c86. {{(pid=91851) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "cinder-87a504ad-4d0e-469e-9dfc-dbdb9524811c-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-87a504ad-4d0e-469e-9dfc-dbdb9524811c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "cinder-quobyte-87a504ad-4d0e-469e-9dfc-dbdb9524811c" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-quobyte-87a504ad-4d0e-469e-9dfc-dbdb9524811c" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f471a-b3bb-4cf2-9fb2-bc9b7aefaf98]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:58:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:52 devstack sudo[111346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c
Jun 16 18:58:52 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:53 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c" returned: 0 in 0.693s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:53 devstack sudo[111351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c
Jun 16 18:58:53 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:54 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-87a504ad-4d0e-469e-9dfc-dbdb9524811c" returned: 0 in 0.576s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-quobyte-87a504ad-4d0e-469e-9dfc-dbdb9524811c" released by "delete_volume" :: held 1.310s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Created reservations ['0ad304fe-4d46-465d-b8db-7810e4c074c7', '7aeffabb-0b2b-4458-9ee8-651b4901ec05', 'ef18162d-ac94-4a92-9b0d-53c728ffff47', '0247735a-f051-4617-9fc3-32bde15753ba'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:54 devstack sudo[111354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:58:54 devstack sudo[111354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:54 devstack sudo[111354]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.588s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:58:54 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Deleted volume successfully.
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-f2da9873-9e96-45f3-a979-fcf08f81c892 tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-87a504ad-4d0e-469e-9dfc-dbdb9524811c-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "cinder-790af574-481a-4c17-b537-e49a061b2be3-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-790af574-481a-4c17-b537-e49a061b2be3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "cinder-quobyte-790af574-481a-4c17-b537-e49a061b2be3" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:58:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-quobyte-790af574-481a-4c17-b537-e49a061b2be3" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:58:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad63dd66-cee2-4e31-911d-de957ec7f819]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:58:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:55 devstack sudo[111357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3
Jun 16 18:58:55 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:55 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3" returned: 0 in 0.684s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:55 devstack sudo[111362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3
Jun 16 18:58:55 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:56 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-790af574-481a-4c17-b537-e49a061b2be3" returned: 0 in 0.574s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-quobyte-790af574-481a-4c17-b537-e49a061b2be3" released by "delete_volume" :: held 1.295s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Created reservations ['e540e3b1-dd90-4ff2-b2b0-6e5f7ed70582', 'bcbc7f02-3ff2-42b6-a7c4-c9e89266081e', '83016903-fe3b-40f3-ad44-c5ef09161c03', 'f68f88c9-ba2c-4eb9-a56b-4f4d727fb4b8'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:58:56 devstack sudo[111365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:58:56 devstack sudo[111365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:58:56 devstack sudo[111365]: pam_unix(sudo:session): session closed for user root
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:58:56 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:58:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Deleted volume successfully.
Jun 16 18:58:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-158c1026-2eb0-4127-aa01-2c119c5c4c8c tempest-TestServerVolumeAttachmentScenario-1436798672 None] Lock "cinder-790af574-481a-4c17-b537-e49a061b2be3-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:06 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:59:07 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Flow 'volume_create_manager' (4d80989d-1b97-453a-9600-916161c2dc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3679ca5b-bb86-4e68-afe3-6770a5452a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3679ca5b-bb86-4e68-afe3-6770a5452a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dcd9de-3dad-4fcb-8718-ab709f9f4ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c743fe8124df79da74969792d676b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:08Z,use_quota=True,user_id='d4a8ae12ff62419f990f45a82118e47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656282fa-597b-4bae-bd91-5f4c69d2e5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656282fa-597b-4bae-bd91-5f4c69d2e5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b168110-07df-4995-9307-7cafae3a213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b168110-07df-4995-9307-7cafae3a213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '75dcd9de-3dad-4fcb-8718-ab709f9f4ed0', 'volume_name': 'volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0', 'volume_size': 1, 'image_id': '65e67ead-26af-4201-bce0-183966d72de7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65e67ead-26af-4201-bce0-183966d72de7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a082b8155ccaa8c49d64ffe9cbb21bb9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '049c743fe8124df79da74969792d676b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'daf237ae2340ee315da2fdd15ff211acce9665bc054e441b054c122210c0eca5b0a950043f3ba8a3e5201595eb1c6a970bcaa7185cd50bf705c9cc027487c418', 'id': '65e67ead-26af-4201-bce0-183966d72de7', 'created_at': datetime.datetime(2026, 6, 16, 16, 59, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 59, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65e67ead-26af-4201-bce0-183966d72de7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b782630>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6104be-d0a0-466e-9f1c-a25eb9423388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6104be-d0a0-466e-9f1c-a25eb9423388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a56b80-a87c-4b24-9e06-eff152ede78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Volume 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0', 'volume_size': 1, 'image_id': '65e67ead-26af-4201-bce0-183966d72de7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65e67ead-26af-4201-bce0-183966d72de7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a082b8155ccaa8c49d64ffe9cbb21bb9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '049c743fe8124df79da74969792d676b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'daf237ae2340ee315da2fdd15ff211acce9665bc054e441b054c122210c0eca5b0a950043f3ba8a3e5201595eb1c6a970bcaa7185cd50bf705c9cc027487c418', 'id': '65e67ead-26af-4201-bce0-183966d72de7', 'created_at': datetime.datetime(2026, 6, 16, 16, 59, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 59, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65e67ead-26af-4201-bce0-183966d72de7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b782630>}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Trying to clone 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 from image 65e67ead-26af-4201-bce0-183966d72de7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65e67ead-26af-4201-bce0-183966d72de7', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:59:08 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Image download 0.00 MB at 0.00 MB/s
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4c239-266f-4a23-a19f-edd9fa5af5d1]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:08 devstack sudo[111376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD
Jun 16 18:59:08 devstack sudo[111376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:09 devstack sudo[111376]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:09 devstack sudo[111380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD
Jun 16 18:59:09 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:09 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD" returned: 1 in 0.654s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Temporary image 65e67ead-26af-4201-bce0-183966d72de7 is fetched for user d4a8ae12ff62419f990f45a82118e47c. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697f833-9122-4249-b190-b0a6d39c81f5]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:10 devstack sudo[111388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD
Jun 16 18:59:10 devstack sudo[111388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:10 devstack sudo[111388]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:10 devstack sudo[111392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD
Jun 16 18:59:10 devstack sudo[111392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:11 devstack sudo[111392]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD" returned: 1 in 0.676s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dcd9de-3dad-4fcb-8718-ab709f9f4ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c743fe8124df79da74969792d676b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:08Z,use_quota=True,user_id='d4a8ae12ff62419f990f45a82118e47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Creating volume 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:11 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:59:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:11 devstack sudo[111397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 1073741824
Jun 16 18:59:11 devstack sudo[111397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:12 devstack sudo[111397]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 1073741824" returned: 0 in 0.755s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:12 devstack sudo[111402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:12 devstack sudo[111402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:12 devstack sudo[111402]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 0 in 0.581s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Attempting download of 65e67ead-26af-4201-bce0-183966d72de7 ((None, [{'url': 'file:///opt/stack/data/glance/images/65e67ead-26af-4201-bce0-183966d72de7', 'metadata': {}}])) to volume 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0704e9-bab3-4b86-9339-d0fd846b379d]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:12 devstack sudo[111405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn
Jun 16 18:59:12 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:13 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn" returned: 0 in 0.670s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:13 devstack sudo[111409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn
Jun 16 18:59:13 devstack sudo[111409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:14 devstack sudo[111409]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn" returned: 1 in 0.661s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65e67ead-26af-4201-bce0-183966d72de7_b4av_zfn' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:14 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[134581a0-5239-45b4-b9f1-5c2c6bc1560b]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:14 devstack sudo[111413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD
Jun 16 18:59:14 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:14 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:14 devstack sudo[111417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD
Jun 16 18:59:14 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:15 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD" returned: 1 in 0.643s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:15 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] 65e67ead-26af-4201-bce0-183966d72de7 was raw, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:59:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:15 devstack sudo[111422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:15 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:16 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 0 in 0.639s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:16 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65e67ead-26af-4201-bce0-183966d72de7_ty2ntfnedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:59:16 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Converted 0.00 MB image at 0.00 MB/s
Jun 16 18:59:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:16 devstack sudo[111427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 1G
Jun 16 18:59:16 devstack sudo[111427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:16 devstack sudo[111427]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 1G" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:16 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aadd78f-865c-4206-9671-f768531a821e]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:16 devstack sudo[111432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:16 devstack sudo[111432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:17 devstack sudo[111432]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 0 in 0.655s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:17 devstack sudo[111436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:17 devstack sudo[111436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:18 devstack sudo[111436]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 1 in 0.653s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Downloaded image 65e67ead-26af-4201-bce0-183966d72de7 ((None, [{'url': 'file:///opt/stack/data/glance/images/65e67ead-26af-4201-bce0-183966d72de7', 'metadata': {}}])) to volume 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Temporary image 65e67ead-26af-4201-bce0-183966d72de7 for user d4a8ae12ff62419f990f45a82118e47c is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Marking volume 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Copying metadata from image 65e67ead-26af-4201-bce0-183966d72de7 to 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Creating volume glance metadata for volume 75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 backed by image 65e67ead-26af-4201-bce0-183966d72de7 with: {'image_id': '65e67ead-26af-4201-bce0-183966d72de7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a082b8155ccaa8c49d64ffe9cbb21bb9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a56b80-a87c-4b24-9e06-eff152ede78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0', 'volume_size': 1, 'image_id': '65e67ead-26af-4201-bce0-183966d72de7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65e67ead-26af-4201-bce0-183966d72de7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a082b8155ccaa8c49d64ffe9cbb21bb9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '049c743fe8124df79da74969792d676b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'daf237ae2340ee315da2fdd15ff211acce9665bc054e441b054c122210c0eca5b0a950043f3ba8a3e5201595eb1c6a970bcaa7185cd50bf705c9cc027487c418', 'id': '65e67ead-26af-4201-bce0-183966d72de7', 'created_at': datetime.datetime(2026, 6, 16, 16, 59, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 59, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65e67ead-26af-4201-bce0-183966d72de7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b782630>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a64dcc8-913a-40b1-a389-ce80214a6ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:18 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Volume volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 (75dcd9de-3dad-4fcb-8718-ab709f9f4ed0): created successfully
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a64dcc8-913a-40b1-a389-ce80214a6ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Flow 'volume_create_manager' (4d80989d-1b97-453a-9600-916161c2dc9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b4f883fe-253b-42e8-b59e-1c592b2b73b5 tempest-VolumeImageDependencyTests-300939063 None] Created volume successfully.
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Acquiring lock "cinder-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Lock "cinder-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Acquiring lock "cinder-quobyte-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Lock "cinder-quobyte-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b378a6-883f-4ce3-9de1-0212f96c79a5]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:18 devstack sudo[111441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:18 devstack sudo[111441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:19 devstack sudo[111441]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 0 in 0.661s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:19 devstack sudo[111445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:19 devstack sudo[111445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:20 devstack sudo[111445]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 1 in 0.664s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:20 devstack sudo[111451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0
Jun 16 18:59:20 devstack sudo[111451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:20 devstack sudo[111451]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" returned: 0 in 0.557s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Lock "cinder-quobyte-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0" released by "delete_volume" :: held 1.947s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Created reservations ['663c98da-1f59-4350-b155-608a2afd446b', 'bf64cdf3-2857-460c-a67c-d095a8588280', '91d0c4ad-b953-4092-9f66-8ffd9bbdf577', '9620af1d-9522-45ee-ac70-786c4bffbdb0'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:20 devstack sudo[111454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:59:20 devstack sudo[111454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:21 devstack sudo[111454]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.595s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:21 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:59:21 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Deleted volume successfully.
Jun 16 18:59:21 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ce382460-ccee-4653-a8c6-8fea1e6d00aa tempest-VolumeImageDependencyTests-300939063 None] Lock "cinder-75dcd9de-3dad-4fcb-8718-ab709f9f4ed0-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:30 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=8 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:59:31 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:INSERT=6,cinder:DELETE=2 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Flow 'volume_create_manager' (a9aae788-5c90-4965-b47d-fa0030616b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e260c15c-1a4c-4428-a265-5b1007a2c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e260c15c-1a4c-4428-a265-5b1007a2c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-953700035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6962bff-8ff9-44bc-b665-fb178e30c53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3621c82eae084f448e8a1d8149234fe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:32Z,use_quota=True,user_id='4c45cc1f7adf4fd6b9f5c930cf9d1a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0b8e95-5464-4c41-a8b0-5fceb4aaabc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0b8e95-5464-4c41-a8b0-5fceb4aaabc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459c6013-a0fc-4d4f-b84d-e3e2eeb94a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459c6013-a0fc-4d4f-b84d-e3e2eeb94a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6962bff-8ff9-44bc-b665-fb178e30c53f', 'volume_name': 'volume-d6962bff-8ff9-44bc-b665-fb178e30c53f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe382243-fe51-4880-88f1-ad50991388f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe382243-fe51-4880-88f1-ad50991388f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9066f10-a7ea-410b-99e2-303d3288dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Volume d6962bff-8ff9-44bc-b665-fb178e30c53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6962bff-8ff9-44bc-b665-fb178e30c53f', 'volume_size': 1}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-953700035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6962bff-8ff9-44bc-b665-fb178e30c53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3621c82eae084f448e8a1d8149234fe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:32Z,use_quota=True,user_id='4c45cc1f7adf4fd6b9f5c930cf9d1a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Creating volume d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:32 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:32 devstack sudo[111536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f 1073741824
Jun 16 18:59:32 devstack sudo[111536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Flow 'volume_create_manager' (d02215ee-6721-4e8d-8ca9-14e7ba7bbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f3aaf7-86c3-4450-8804-992bb07aa061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f3aaf7-86c3-4450-8804-992bb07aa061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b32e75-32c8-47b6-aa54-dc488e92567e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74affc6ca492451e94c8767f44ee63c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:33Z,use_quota=True,user_id='fc07dd13375d446cbc682c645a3680a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9008bdd-b391-4371-957b-837985d051f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9008bdd-b391-4371-957b-837985d051f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c79d61-ef65-4cd7-bd70-feb1a59a4918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c79d61-ef65-4cd7-bd70-feb1a59a4918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b32e75-32c8-47b6-aa54-dc488e92567e', 'volume_name': 'volume-a6b32e75-32c8-47b6-aa54-dc488e92567e', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b308c1-c010-4735-954c-073184237586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b308c1-c010-4735-954c-073184237586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20699a3-920e-404f-a3df-ea4ee6def508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:32 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Volume a6b32e75-32c8-47b6-aa54-dc488e92567e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b32e75-32c8-47b6-aa54-dc488e92567e', 'volume_size': 1}
Jun 16 18:59:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (c405f70e-df80-45dc-8a36-4129deb7d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1176e1bb-1b1f-4227-859c-cbc06e234b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1176e1bb-1b1f-4227-859c-cbc06e234b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699473540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172f7932-827a-4974-9a5b-f7b843a3b3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:33Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afebe7e8-652a-4565-b926-55ee028911fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afebe7e8-652a-4565-b926-55ee028911fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f733f5-6ffe-46e3-9803-7f6fdb19dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f733f5-6ffe-46e3-9803-7f6fdb19dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172f7932-827a-4974-9a5b-f7b843a3b3c5', 'volume_name': 'volume-172f7932-827a-4974-9a5b-f7b843a3b3c5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9ecf9d-3d3a-4251-a803-20a81e3c2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9ecf9d-3d3a-4251-a803-20a81e3c2f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549c6b51-2205-40f3-9ac8-83f73f510bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:33 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume 172f7932-827a-4974-9a5b-f7b843a3b3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172f7932-827a-4974-9a5b-f7b843a3b3c5', 'volume_size': 1}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:33 devstack sudo[111536]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f 1073741824" returned: 0 in 0.928s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:33 devstack sudo[111544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 18:59:33 devstack sudo[111544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:34 devstack sudo[111544]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.621s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.324s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b32e75-32c8-47b6-aa54-dc488e92567e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74affc6ca492451e94c8767f44ee63c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:33Z,use_quota=True,user_id='fc07dd13375d446cbc682c645a3680a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Creating volume a6b32e75-32c8-47b6-aa54-dc488e92567e {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:34 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9066f10-a7ea-410b-99e2-303d3288dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6962bff-8ff9-44bc-b665-fb178e30c53f', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:34 devstack sudo[111547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e 1073741824
Jun 16 18:59:34 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53640a5a-ea3d-4352-bb24-a1776bcc9c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:34 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Volume volume-d6962bff-8ff9-44bc-b665-fb178e30c53f (d6962bff-8ff9-44bc-b665-fb178e30c53f): created successfully
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53640a5a-ea3d-4352-bb24-a1776bcc9c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Flow 'volume_create_manager' (a9aae788-5c90-4965-b47d-fa0030616b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:34 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-36d95ac5-62c8-47b6-a631-b90d2c5f54c0 tempest-VolumeDependencyTests-1937853275 None] Created volume successfully.
Jun 16 18:59:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:35 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e 1073741824" returned: 0 in 0.840s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:35 devstack sudo[111554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e
Jun 16 18:59:35 devstack sudo[111554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:35 devstack sudo[111554]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e" returned: 0 in 0.600s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.348s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699473540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172f7932-827a-4974-9a5b-f7b843a3b3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:33Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating volume 172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:35 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20699a3-920e-404f-a3df-ea4ee6def508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b32e75-32c8-47b6-aa54-dc488e92567e', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:35 devstack sudo[111557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 1073741824
Jun 16 18:59:35 devstack sudo[111557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6727ee4-ddc9-4430-975b-68e0137d2d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:35 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Volume volume-a6b32e75-32c8-47b6-aa54-dc488e92567e (a6b32e75-32c8-47b6-aa54-dc488e92567e): created successfully
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6727ee4-ddc9-4430-975b-68e0137d2d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:35 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Flow 'volume_create_manager' (d02215ee-6721-4e8d-8ca9-14e7ba7bbb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:35 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4a752816-b824-45b7-90f0-0e71ad26de57 tempest-CinderUnicodeTest-1663481298 None] Created volume successfully.
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Flow 'volume_create_manager' (d2cc7606-5d3c-4b5e-9cbb-41ba59c09795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7aa1cf1-1590-4d10-88d4-867962a85ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7aa1cf1-1590-4d10-88d4-867962a85ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a63c17-4285-413f-977b-a1812b60fe48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0b9457703b48b0a8f4bf43a7a19ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:36Z,use_quota=True,user_id='bca5ab436a1b44989bc1b5a09650b732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e52541f4-cc19-45f0-9735-def837eaedda),volume_type_id=e52541f4-cc19-45f0-9735-def837eaedda)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d277384-6dfb-44c8-82c1-04ae8f740f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d277384-6dfb-44c8-82c1-04ae8f740f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fefd54-14d7-4f44-99fb-714bab994232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fefd54-14d7-4f44-99fb-714bab994232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30a63c17-4285-413f-977b-a1812b60fe48', 'volume_name': 'volume-30a63c17-4285-413f-977b-a1812b60fe48', 'volume_size': 1, 'image_id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13ebe0b1-0634-4609-8608-b8a61c5692b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '471d90f5d21f2f6d1402d873e6b7e00c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a0b9457703b48b0a8f4bf43a7a19ca1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89f3a768334e199d387650654c97fab86d03a73a71a78f082bb9e2eaa0e372bdb89fbb1fc8b69561f365ed24314ee83237655c7441d0f4ee3260fdb4413a38c4', 'id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'created_at': datetime.datetime(2026, 6, 16, 16, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13ebe0b1-0634-4609-8608-b8a61c5692b5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b76b2f0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2167047e-7d4e-4109-9a5d-fcd0b3e5d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2167047e-7d4e-4109-9a5d-fcd0b3e5d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:36 devstack sudo[111557]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781fe532-fad4-455d-ac9b-6066dbb132af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:36 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Volume 30a63c17-4285-413f-977b-a1812b60fe48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30a63c17-4285-413f-977b-a1812b60fe48', 'volume_size': 1, 'image_id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13ebe0b1-0634-4609-8608-b8a61c5692b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '471d90f5d21f2f6d1402d873e6b7e00c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a0b9457703b48b0a8f4bf43a7a19ca1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89f3a768334e199d387650654c97fab86d03a73a71a78f082bb9e2eaa0e372bdb89fbb1fc8b69561f365ed24314ee83237655c7441d0f4ee3260fdb4413a38c4', 'id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'created_at': datetime.datetime(2026, 6, 16, 16, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13ebe0b1-0634-4609-8608-b8a61c5692b5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b76b2f0>}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Trying to clone 30a63c17-4285-413f-977b-a1812b60fe48 from image 13ebe0b1-0634-4609-8608-b8a61c5692b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/13ebe0b1-0634-4609-8608-b8a61c5692b5', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 1073741824" returned: 0 in 0.792s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:36 devstack sudo[111563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5
Jun 16 18:59:36 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 18:59:36 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Image download 0.00 MB at 0.00 MB/s
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5349059-5b54-4fa4-b366-645035e59c2a]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:36 devstack sudo[111565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD
Jun 16 18:59:36 devstack sudo[111565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:37 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5" returned: 0 in 0.617s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.258s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549c6b51-2205-40f3-9ac8-83f73f510bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172f7932-827a-4974-9a5b-f7b843a3b3c5', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240dd1de-c914-498d-bb14-9694f79e08a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Creating offline snapshot 7787b3a7-aee3-489f-a0a3-efca1770b574 of volume d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:59:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 (172f7932-827a-4974-9a5b-f7b843a3b3c5): created successfully
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240dd1de-c914-498d-bb14-9694f79e08a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (c405f70e-df80-45dc-8a36-4129deb7d406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[54360668-853e-49fa-8f19-23b10b51f4ed]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:37 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2765de05-16a5-4158-bd15-92e94996d39a tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created volume successfully.
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:37 devstack sudo[111565]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Flow 'volume_create_manager' (903fef29-02c4-4ef5-ac6f-f956d8185b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:37 devstack sudo[111570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 18:59:37 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899d8e20-37bc-4115-987d-f0bf36c73a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899d8e20-37bc-4115-987d-f0bf36c73a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1198083520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b59e64-c173-4d29-ac0b-f4371a7032e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74affc6ca492451e94c8767f44ee63c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:37Z,use_quota=True,user_id='fc07dd13375d446cbc682c645a3680a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d927b078-39bf-4877-8748-e2c02a5fb2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d927b078-39bf-4877-8748-e2c02a5fb2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176c5749-22c0-40f8-8f91-f1087baf269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176c5749-22c0-40f8-8f91-f1087baf269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b59e64-c173-4d29-ac0b-f4371a7032e1', 'volume_name': 'volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4318e947-829c-44b5-9ac7-0a63c69471cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4318e947-829c-44b5-9ac7-0a63c69471cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ada021-2ede-48bc-8a31-a419b0425059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Volume f6b59e64-c173-4d29-ac0b-f4371a7032e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1', 'volume_size': 1}
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:37 devstack sudo[111574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD
Jun 16 18:59:37 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:38 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.742s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:38 devstack sudo[111580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 1G
Jun 16 18:59:38 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:38 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD" returned: 1 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Temporary image 13ebe0b1-0634-4609-8608-b8a61c5692b5 is fetched for user bca5ab436a1b44989bc1b5a09650b732. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e3fc3-6403-4acd-85b9-fbc9eeb4c7a8]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:38 devstack sudo[111584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD
Jun 16 18:59:38 devstack sudo[111584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:38 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 1G" returned: 0 in 0.723s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6962bff-8ff9-44bc-b665-fb178e30c53f -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:38 devstack sudo[111589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6962bff-8ff9-44bc-b665-fb178e30c53f -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574
Jun 16 18:59:38 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:38 devstack sudo[111584]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:39 devstack sudo[111593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD
Jun 16 18:59:39 devstack sudo[111593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:39 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6962bff-8ff9-44bc-b665-fb178e30c53f -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:39 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 is being set with open permissions: ugo+rw
Jun 16 18:59:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:39 devstack sudo[111598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574
Jun 16 18:59:39 devstack sudo[111598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:39 devstack sudo[111593]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD" returned: 1 in 0.697s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:40 devstack sudo[111598]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:40 devstack sudo[111605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info
Jun 16 18:59:40 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:40 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:40 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info is being set with open permissions: ugo+rw
Jun 16 18:59:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:40 devstack sudo[111608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info
Jun 16 18:59:40 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:41 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.info" returned: 0 in 0.598s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.994s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.711s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1198083520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b59e64-c173-4d29-ac0b-f4371a7032e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74affc6ca492451e94c8767f44ee63c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:37Z,use_quota=True,user_id='fc07dd13375d446cbc682c645a3680a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Creating volume f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:41 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:59:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:41 devstack sudo[111611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 1073741824
Jun 16 18:59:41 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-59f5a0ac-1666-4801-8d4c-f2bfff2143d9 tempest-VolumeDependencyTests-1937853275 None] Create snapshot completed successfully
Jun 16 18:59:42 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 1073741824" returned: 0 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:42 devstack sudo[111616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:59:42 devstack sudo[111616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:42 devstack sudo[111618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1
Jun 16 18:59:42 devstack sudo[111618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Flow 'volume_create_manager' (485ebd2c-084a-48d8-9efd-455ff24b0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f93a36-6f5e-4dc4-b4b7-80408944c2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:42 devstack sudo[111616]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f93a36-6f5e-4dc4-b4b7-80408944c2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2077070280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5413792-9aa4-4f5d-bb29-c2fdacd193ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3621c82eae084f448e8a1d8149234fe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7787b3a7-aee3-489f-a0a3-efca1770b574,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:43Z,use_quota=True,user_id='4c45cc1f7adf4fd6b9f5c930cf9d1a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade5c6d-eb29-4157-b702-a8032aa7fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade5c6d-eb29-4157-b702-a8032aa7fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6bdaa5-6826-4862-9b7c-dd6ab272001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:42 devstack sudo[111618]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6bdaa5-6826-4862-9b7c-dd6ab272001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5413792-9aa4-4f5d-bb29-c2fdacd193ab', 'volume_name': 'volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab', 'volume_size': 1, 'snapshot_id': '7787b3a7-aee3-489f-a0a3-efca1770b574'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8822601-742d-4e8d-9384-29c464c2e223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8822601-742d-4e8d-9384-29c464c2e223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fbc02c-c051-49df-b6b0-06cde3b9860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Volume e5413792-9aa4-4f5d-bb29-c2fdacd193ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab', 'volume_size': 1, 'snapshot_id': '7787b3a7-aee3-489f-a0a3-efca1770b574'}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.738s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1" returned: 0 in 0.692s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.968s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 28 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating offline snapshot d269c4ae-b66f-4d85-a4d6-c5660d017755 of volume 172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ada021-2ede-48bc-8a31-a419b0425059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d877b6c-c2c2-49a0-9d28-2342178fb22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c18a30-8700-4788-a178-a5c5e1634ac4]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Volume volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 (f6b59e64-c173-4d29-ac0b-f4371a7032e1): created successfully
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d877b6c-c2c2-49a0-9d28-2342178fb22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Flow 'volume_create_manager' (903fef29-02c4-4ef5-ac6f-f956d8185b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-f074aca0-8abd-43d1-82ba-dee46c925031 tempest-CinderUnicodeTest-1663481298 None] Created volume successfully.
Jun 16 18:59:42 devstack sudo[111622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5
Jun 16 18:59:42 devstack sudo[111622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:43 devstack sudo[111622]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5" returned: 0 in 0.704s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:43 devstack sudo[111627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 1G
Jun 16 18:59:43 devstack sudo[111627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:44 devstack sudo[111627]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 1G" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:44 devstack sudo[111632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755
Jun 16 18:59:44 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:44 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755" returned: 0 in 0.623s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:44 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 is being set with open permissions: ugo+rw
Jun 16 18:59:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:44 devstack sudo[111638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755
Jun 16 18:59:44 devstack sudo[111638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:45 devstack sudo[111638]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755" returned: 0 in 0.579s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:45 devstack sudo[111641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info
Jun 16 18:59:45 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:46 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info" returned: 0 in 0.612s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:46 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info is being set with open permissions: ugo+rw
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:46 devstack sudo[111644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info
Jun 16 18:59:46 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:46 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.info" returned: 0 in 0.565s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.926s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.061s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a63c17-4285-413f-977b-a1812b60fe48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0b9457703b48b0a8f4bf43a7a19ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:36Z,use_quota=True,user_id='bca5ab436a1b44989bc1b5a09650b732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e52541f4-cc19-45f0-9735-def837eaedda),volume_type_id=e52541f4-cc19-45f0-9735-def837eaedda)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Creating volume 30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:46 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 18:59:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:46 devstack sudo[111647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 1073741824
Jun 16 18:59:46 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fe07b12b-60e5-4be3-966c-6b396cac0732 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Create snapshot completed successfully
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:47 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (6e765854-ad53-4b0e-a57d-5c0db51ea7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f112388-392a-4e41-abf9-143c56e03a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 1073741824" returned: 0 in 0.805s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f112388-392a-4e41-abf9-143c56e03a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1247115416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f0fff1-e0b6-419a-80aa-ffde06860d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:47Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76068345-7f8d-471d-964b-41b4be054c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76068345-7f8d-471d-964b-41b4be054c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a2a92-957b-43ed-96fb-43db0885adcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a2a92-957b-43ed-96fb-43db0885adcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f0fff1-e0b6-419a-80aa-ffde06860d9e', 'volume_name': 'volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b626cb-8e2e-4ebc-8c6a-c2fdc65b06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b626cb-8e2e-4ebc-8c6a-c2fdc65b06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d524bbd-9474-4b9b-abc3-366b447190af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume b7f0fff1-e0b6-419a-80aa-ffde06860d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e', 'volume_size': 1}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:47 devstack sudo[111653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:47 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (bf40efd8-6720-4428-a10a-2ae2524d37ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdc840e-28c6-4496-b198-a749294d638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdc840e-28c6-4496-b198-a749294d638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451376574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbc1fd8-f40f-4a9b-94b6-599f76253541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:48Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65166987-34a8-4ee3-b1a1-739c8bc63e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65166987-34a8-4ee3-b1a1-739c8bc63e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11ac132-4756-47f2-8259-ef6a362f4c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11ac132-4756-47f2-8259-ef6a362f4c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbc1fd8-f40f-4a9b-94b6-599f76253541', 'volume_name': 'volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d373b1-1775-4bea-a00f-0d89e82cd2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d373b1-1775-4bea-a00f-0d89e82cd2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7098f02-7712-4956-8006-88d2b1d84644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:47 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume 0dbc1fd8-f40f-4a9b-94b6-599f76253541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541', 'volume_size': 1}
Jun 16 18:59:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (b72dfb0d-83df-419d-91f0-c2ef29cd884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4575af76-e4cc-4f1a-b3cd-bee1d7dff18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4575af76-e4cc-4f1a-b3cd-bee1d7dff18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-44875666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6257a4-ed4b-4ebb-81db-9e44f97f9e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:48Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803f21cf-0843-4691-b56d-7410e8b91c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803f21cf-0843-4691-b56d-7410e8b91c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab81c79-be42-4a91-aa55-6c2ecd9d159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab81c79-be42-4a91-aa55-6c2ecd9d159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6257a4-ed4b-4ebb-81db-9e44f97f9e67', 'volume_name': 'volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8004a6cf-a632-450b-bf85-813326b6aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8004a6cf-a632-450b-bf85-813326b6aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12524ff-5cc8-4e7c-bf6e-de04cb2e733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume 4c6257a4-ed4b-4ebb-81db-9e44f97f9e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67', 'volume_size': 1}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 0 in 0.641s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.458s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-quobyte-7787b3a7-aee3-489f-a0a3-efca1770b574-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-7787b3a7-aee3-489f-a0a3-efca1770b574-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Creating volume e5413792-9aa4-4f5d-bb29-c2fdacd193ab from snapshot 7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-quobyte-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Attempting download of 13ebe0b1-0634-4609-8608-b8a61c5692b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/13ebe0b1-0634-4609-8608-b8a61c5692b5', 'metadata': {}}])) to volume 30a63c17-4285-413f-977b-a1812b60fe48. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] snapshot: 7787b3a7-aee3-489f-a0a3-efca1770b574, volume: e5413792-9aa4-4f5d-bb29-c2fdacd193ab,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2204b8-85e3-4726-ae68-62bebf67dfe0]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdbe171-241b-4aa0-95f8-e7eba030e9b3]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:48 devstack sudo[111656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574
Jun 16 18:59:48 devstack sudo[111656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:48 devstack sudo[111657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0
Jun 16 18:59:48 devstack sudo[111657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (6ccd3385-ac5b-4e42-91c6-d6991fae1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190c16ec-6001-4c55-b95d-b325a01a3950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190c16ec-6001-4c55-b95d-b325a01a3950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640988976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:49Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293b5df5-80e6-4d05-9e66-889f6064bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293b5df5-80e6-4d05-9e66-889f6064bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511ea0f6-e87d-471c-9470-08787fe76602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511ea0f6-e87d-471c-9470-08787fe76602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe', 'volume_name': 'volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22605ca7-d029-4032-a537-095af10fdfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22605ca7-d029-4032-a537-095af10fdfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c03e54-4068-4024-aa10-890c502149b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:48 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume 7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe', 'volume_size': 1}
Jun 16 18:59:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:49 devstack sudo[111657]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (a5e2dc98-11f9-4e37-922d-f058962e5f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:49 devstack sudo[111656]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03db48f-62fb-4ebb-b241-734cc2da35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0" returned: 0 in 0.823s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574" returned: 0 in 0.843s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6962bff-8ff9-44bc-b665-fb178e30c53f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03db48f-62fb-4ebb-b241-734cc2da35ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134935938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d867f6fe-57e6-4847-b787-93bf1cb99c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:49Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f624db64-8d62-4ea1-b63a-3b0999ff1b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f624db64-8d62-4ea1-b63a-3b0999ff1b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48326366-99d0-40ab-a0d3-b3bd638b61ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48326366-99d0-40ab-a0d3-b3bd638b61ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd867f6fe-57e6-4847-b787-93bf1cb99c7b', 'volume_name': 'volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ee98bb-3f46-4faa-928f-7d43b88ad249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ee98bb-3f46-4faa-928f-7d43b88ad249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e25cc-0b64-48ea-a4b6-dc5aedf29132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:49 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume d867f6fe-57e6-4847-b787-93bf1cb99c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b', 'volume_size': 1}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[17302da3-6794-47a4-a817-9cd7693d7452]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:49 devstack sudo[111666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0
Jun 16 18:59:49 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:49 devstack sudo[111667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 18:59:49 devstack sudo[111667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:49 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0" returned: 1 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13ebe0b1-0634-4609-8608-b8a61c5692b5_2h2bj8i0' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[de805b37-82ff-4976-a3a9-05d9257af718]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:49 devstack sudo[111667]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.692s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 18:59:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:50 devstack sudo[111677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab
Jun 16 18:59:50 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:50 devstack sudo[111675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD
Jun 16 18:59:50 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:50 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:50 devstack sudo[111686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD
Jun 16 18:59:50 devstack sudo[111686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:51 devstack sudo[111686]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD" returned: 1 in 1.260s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:51 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] 13ebe0b1-0634-4609-8608-b8a61c5692b5 was raw, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 18:59:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:51 devstack sudo[111698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:51 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:53 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 0 in 1.326s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:53 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_13ebe0b1-0634-4609-8608-b8a61c5692b5_rdnv592jdevstack@QuobyteHD, size 0.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:59:53 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Converted 0.00 MB image at 0.00 MB/s
Jun 16 18:59:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:53 devstack sudo[111703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 1G
Jun 16 18:59:53 devstack sudo[111703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:54 devstack sudo[111703]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 1G" returned: 0 in 1.267s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:54 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db97859-95ec-4d75-b26a-1f55ea9db33e]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:54 devstack sudo[111708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:54 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:55 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" returned: 0 in 5.042s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f22dfd8-3260-44c2-9ea4-e5c3621e06b5]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:55 devstack sudo[111710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 18:59:55 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:55 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 0 in 0.886s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:55 devstack sudo[111714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:55 devstack sudo[111714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:55 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.870s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 18:59:55 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Converted 1024.00 MB image at 203.05 MB/s
Jun 16 18:59:55 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab is being set with open permissions: ugo+rw
Jun 16 18:59:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:55 devstack sudo[111719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab
Jun 16 18:59:55 devstack sudo[111719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:56 devstack sudo[111714]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 1 in 0.734s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Downloaded image 13ebe0b1-0634-4609-8608-b8a61c5692b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/13ebe0b1-0634-4609-8608-b8a61c5692b5', 'metadata': {}}])) to volume 30a63c17-4285-413f-977b-a1812b60fe48 successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Temporary image 13ebe0b1-0634-4609-8608-b8a61c5692b5 for user bca5ab436a1b44989bc1b5a09650b732 is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Marking volume 30a63c17-4285-413f-977b-a1812b60fe48 as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Copying metadata from image 13ebe0b1-0634-4609-8608-b8a61c5692b5 to 30a63c17-4285-413f-977b-a1812b60fe48. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Creating volume glance metadata for volume 30a63c17-4285-413f-977b-a1812b60fe48 backed by image 13ebe0b1-0634-4609-8608-b8a61c5692b5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '471d90f5d21f2f6d1402d873e6b7e00c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781fe532-fad4-455d-ac9b-6066dbb132af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a63c17-4285-413f-977b-a1812b60fe48', 'volume_size': 1, 'image_id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13ebe0b1-0634-4609-8608-b8a61c5692b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '471d90f5d21f2f6d1402d873e6b7e00c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a0b9457703b48b0a8f4bf43a7a19ca1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89f3a768334e199d387650654c97fab86d03a73a71a78f082bb9e2eaa0e372bdb89fbb1fc8b69561f365ed24314ee83237655c7441d0f4ee3260fdb4413a38c4', 'id': '13ebe0b1-0634-4609-8608-b8a61c5692b5', 'created_at': datetime.datetime(2026, 6, 16, 16, 59, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 16, 59, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13ebe0b1-0634-4609-8608-b8a61c5692b5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b76b2f0>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f4e9c9-56ac-4bac-a15e-4330848758f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Volume volume-30a63c17-4285-413f-977b-a1812b60fe48 (30a63c17-4285-413f-977b-a1812b60fe48): created successfully
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f4e9c9-56ac-4bac-a15e-4330848758f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Flow 'volume_create_manager' (d2cc7606-5d3c-4b5e-9cbb-41ba59c09795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b9e91ccb-fa2e-4105-b394-a3516aa16390 tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Created volume successfully.
Jun 16 18:59:56 devstack sudo[111719]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" returned: 0 in 0.636s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" released by "_copy_volume_from_snapshot" :: held 8.238s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-7787b3a7-aee3-489f-a0a3-efca1770b574-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" released by "_create_volume_from_snapshot" :: held 8.272s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.297s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.517s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Creating offline snapshot 0772fd13-923b-4751-b6f0-74198f958384 of volume f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fbc02c-c051-49df-b6b0-06cde3b9860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab', 'volume_size': 1, 'snapshot_id': '7787b3a7-aee3-489f-a0a3-efca1770b574'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038cd00f-09ee-4a99-8ec8-88f518915b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78517ea-0b6a-47f0-bd41-e4e270a2217c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:56 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Volume volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab (e5413792-9aa4-4f5d-bb29-c2fdacd193ab): created successfully
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038cd00f-09ee-4a99-8ec8-88f518915b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Flow 'volume_create_manager' (485ebd2c-084a-48d8-9efd-455ff24b0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 18:59:56 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-558f0cd4-14e2-46ef-8103-1edb1f797eca tempest-VolumeDependencyTests-1937853275 None] Created volume successfully.
Jun 16 18:59:56 devstack sudo[111725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1
Jun 16 18:59:56 devstack sudo[111725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-7787b3a7-aee3-489f-a0a3-efca1770b574-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-7787b3a7-aee3-489f-a0a3-efca1770b574-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-quobyte-d6962bff-8ff9-44bc-b665-fb178e30c53f" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-d6962bff-8ff9-44bc-b665-fb178e30c53f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-quobyte-7787b3a7-aee3-489f-a0a3-efca1770b574" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-7787b3a7-aee3-489f-a0a3-efca1770b574" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Deleting offline snapshot 7787b3a7-aee3-489f-a0a3-efca1770b574 of volume d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] snapshot_file for this snap is: volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c938b7-2f9c-4a70-9f6a-45cc1ebf982c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:56 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:57 devstack sudo[111727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574
Jun 16 18:59:57 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Acquiring lock "cinder-30a63c17-4285-413f-977b-a1812b60fe48-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "cinder-30a63c17-4285-413f-977b-a1812b60fe48-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Acquiring lock "cinder-quobyte-30a63c17-4285-413f-977b-a1812b60fe48" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "cinder-quobyte-30a63c17-4285-413f-977b-a1812b60fe48" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eb1ce4-8641-4932-8687-cc5a9d8bcb63]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:57 devstack sudo[111725]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1" returned: 0 in 0.742s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:57 devstack sudo[111732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:57 devstack sudo[111733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 1G
Jun 16 18:59:57 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:57 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:57 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574" returned: 0 in 0.724s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6962bff-8ff9-44bc-b665-fb178e30c53f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ffd09-b9b0-45c5-820d-fc2219c6899e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 18:59:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:57 devstack sudo[111739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 18:59:57 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:58 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 0 in 0.756s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:58 devstack sudo[111749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:58 devstack sudo[111749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:58 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 1G" returned: 0 in 0.793s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:58 devstack sudo[111751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384
Jun 16 18:59:58 devstack sudo[111751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:58 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.724s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:58 devstack sudo[111756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574
Jun 16 18:59:58 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:58 devstack sudo[111749]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 1 in 0.722s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:58 devstack sudo[111764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48
Jun 16 18:59:58 devstack sudo[111764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:58 devstack sudo[111751]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384" returned: 0 in 0.681s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:58 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 is being set with open permissions: ugo+rw
Jun 16 18:59:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:58 devstack sudo[111766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384
Jun 16 18:59:58 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:59 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574" returned: 0 in 0.724s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:59 devstack sudo[111771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574
Jun 16 18:59:59 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:59 devstack sudo[111764]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-30a63c17-4285-413f-977b-a1812b60fe48" returned: 0 in 0.666s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "cinder-quobyte-30a63c17-4285-413f-977b-a1812b60fe48" released by "delete_volume" :: held 2.217s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Created reservations ['4b550dff-efcf-4108-996c-7aa3384a3ec7', '94bcda57-cdae-4d3f-8fe5-e9b6f053ae21', 'ff9fd631-f6be-496c-84b0-d1c287176e15', 'cd42390e-2588-4a5a-825f-0eb2b80f3676'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:59:59 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384" returned: 0 in 0.656s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:59 devstack sudo[111775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info
Jun 16 18:59:59 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 18:59:59 devstack sudo[111777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 18:59:59 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 18:59:59 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f.7787b3a7-aee3-489f-a0a3-efca1770b574" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-7787b3a7-aee3-489f-a0a3-efca1770b574" released by "_delete_snapshot" :: held 2.881s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-d6962bff-8ff9-44bc-b665-fb178e30c53f" released by "delete_snapshot" :: held 2.907s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Created reservations ['5efab541-40c6-422e-8dc7-b82b00e410a5', 'fc9a52e6-4e4b-4dcc-ba9f-692c3b63a920', '26ccce04-31ba-493f-b372-cef23bc4c50f', '9694a10c-3d8e-4331-9533-e179141bbda7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 18:59:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Delete snapshot completed successfully.
Jun 16 18:59:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-59a9be4c-d544-4fc5-bda2-141952f7d50b tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-7787b3a7-aee3-489f-a0a3-efca1770b574-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-d6962bff-8ff9-44bc-b665-fb178e30c53f-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-d6962bff-8ff9-44bc-b665-fb178e30c53f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-quobyte-d6962bff-8ff9-44bc-b665-fb178e30c53f" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-d6962bff-8ff9-44bc-b665-fb178e30c53f" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6b3d57-0433-4c1d-aba8-3c13ed7ac171]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:00 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info" returned: 0 in 0.686s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:00 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info is being set with open permissions: ugo+rw
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:00 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.654s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:00 devstack sudo[111784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info
Jun 16 19:00:00 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Deleted volume successfully.
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82e68490-d626-4027-9e85-d433cabdcbdd tempest-VolumeAndVolumeTypeFromImageTest-839046999 None] Lock "cinder-30a63c17-4285-413f-977b-a1812b60fe48-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:00 devstack sudo[111783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 19:00:00 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:00 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.info" returned: 0 in 0.613s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.281s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.254s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1247115416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f0fff1-e0b6-419a-80aa-ffde06860d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:47Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating volume b7f0fff1-e0b6-419a-80aa-ffde06860d9e {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:00 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:00 devstack sudo[111791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e 1073741824
Jun 16 19:00:00 devstack sudo[111791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-5eb6fc88-74d2-44f3-9f4c-5253a1d410cb tempest-CinderUnicodeTest-1663481298 None] Create snapshot completed successfully
Jun 16 19:00:00 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.760s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:00 devstack sudo[111793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f
Jun 16 19:00:00 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:01 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d6962bff-8ff9-44bc-b665-fb178e30c53f" returned: 0 in 0.647s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-d6962bff-8ff9-44bc-b665-fb178e30c53f" released by "delete_volume" :: held 1.479s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Created reservations ['0ad946af-380f-41f6-9a4d-9ff1e7957d61', '707aaed4-877f-437c-add5-8f650ac2e296', '7b6c248d-6cce-4365-baba-0d2fc7bc47df', 'eac0982d-a9d2-461d-bec6-fb2d2927f391'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:01 devstack sudo[111791]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e 1073741824" returned: 0 in 0.897s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:01 devstack sudo[111800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:01 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:01 devstack sudo[111802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e
Jun 16 19:00:01 devstack sudo[111802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-0772fd13-923b-4751-b6f0-74198f958384-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-0772fd13-923b-4751-b6f0-74198f958384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-quobyte-f6b59e64-c173-4d29-ac0b-f4371a7032e1" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-f6b59e64-c173-4d29-ac0b-f4371a7032e1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-quobyte-0772fd13-923b-4751-b6f0-74198f958384" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-0772fd13-923b-4751-b6f0-74198f958384" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Deleting offline snapshot 0772fd13-923b-4751-b6f0-74198f958384 of volume f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] snapshot_file for this snap is: volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[342bb998-67a0-4768-8b14-f6b1e90d187a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:02 devstack sudo[111805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-e5413792-9aa4-4f5d-bb29-c2fdacd193ab-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:02 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-e5413792-9aa4-4f5d-bb29-c2fdacd193ab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "cinder-quobyte-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" acquired by "delete_volume" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:02 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.830s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:02 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Deleted volume successfully.
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31af59-b674-4714-b724-93a925919e32]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-9c2ad8f3-4271-440a-831a-4c2eb5637680 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-d6962bff-8ff9-44bc-b665-fb178e30c53f-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:02 devstack sudo[111802]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e" returned: 0 in 0.930s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.761s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451376574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbc1fd8-f40f-4a9b-94b6-599f76253541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:48Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating volume 0dbc1fd8-f40f-4a9b-94b6-599f76253541 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:02 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:02 devstack sudo[111809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab
Jun 16 19:00:02 devstack sudo[111809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d524bbd-9474-4b9b-abc3-366b447190af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d27e66f-e2a8-4b33-b711-345bb9ee74dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:02 devstack sudo[111810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 1073741824
Jun 16 19:00:02 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:02 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e (b7f0fff1-e0b6-419a-80aa-ffde06860d9e): created successfully
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d27e66f-e2a8-4b33-b711-345bb9ee74dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:02 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (6e765854-ad53-4b0e-a57d-5c0db51ea7a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:02 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-30b4ce12-a0bd-4463-ab53-f0da262b6a6c tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created volume successfully.
Jun 16 19:00:03 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384" returned: 0 in 1.152s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:03 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 19:00:03 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb70ab9-5d78-4752-ae90-d0ce87bb5372]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:03 devstack sudo[111816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1
Jun 16 19:00:03 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:03 devstack sudo[111809]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" returned: 0 in 1.134s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:03 devstack sudo[111825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab
Jun 16 19:00:03 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:04 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 1073741824" returned: 0 in 1.275s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:04 devstack sudo[111828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541
Jun 16 19:00:04 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:04 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1" returned: 0 in 0.912s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:04 devstack sudo[111833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384
Jun 16 19:00:04 devstack sudo[111833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:04 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" returned: 0 in 0.742s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-quobyte-e5413792-9aa4-4f5d-bb29-c2fdacd193ab" released by "delete_volume" :: held 1.952s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Created reservations ['b279c701-2868-450a-9f45-9cdcdfcb1506', '40cdd20f-8f80-4f85-910d-775ab90a366d', '588d98b5-6e16-4e3e-a136-e52d69f22181', '38e2eddf-879b-49a0-8999-d82972eab5f7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:04 devstack sudo[111836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:04 devstack sudo[111836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:04 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541" returned: 0 in 0.706s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.541s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-44875666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6257a4-ed4b-4ebb-81db-9e44f97f9e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:48Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating volume 4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:04 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:04 devstack sudo[111841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 1073741824
Jun 16 19:00:04 devstack sudo[111841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7098f02-7712-4956-8006-88d2b1d84644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5862b031-1d42-4907-a46d-e94e538b372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:04 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 (0dbc1fd8-f40f-4a9b-94b6-599f76253541): created successfully
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5862b031-1d42-4907-a46d-e94e538b372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:04 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (bf40efd8-6720-4428-a10a-2ae2524d37ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-677dfdfd-764a-4f0f-b028-84f354ebe8d8 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created volume successfully.
Jun 16 19:00:05 devstack sudo[111833]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384" returned: 0 in 1.033s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:05 devstack sudo[111846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384
Jun 16 19:00:05 devstack sudo[111846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:05 devstack sudo[111836]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.862s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:05 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:05 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Deleted volume successfully.
Jun 16 19:00:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-78403e2c-b75a-4801-bfee-3b7cf6e08da6 tempest-VolumeDependencyTests-1937853275 None] Lock "cinder-e5413792-9aa4-4f5d-bb29-c2fdacd193ab-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:06 devstack sudo[111841]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 1073741824" returned: 0 in 1.288s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:06 devstack sudo[111854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67
Jun 16 19:00:06 devstack sudo[111854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:06 devstack sudo[111846]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1.0772fd13-923b-4751-b6f0-74198f958384" returned: 0 in 0.872s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-0772fd13-923b-4751-b6f0-74198f958384" released by "_delete_snapshot" :: held 4.138s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-f6b59e64-c173-4d29-ac0b-f4371a7032e1" released by "delete_snapshot" :: held 4.175s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Created reservations ['8ad76adf-36bf-447e-95c6-d2d015b71722', 'ed7091e8-d202-4e32-ba73-af6fb5baedb1', 'a3d6c036-0f44-4bd3-8dc9-77ae98f319c2', '1e38ba59-1fd6-4622-bcec-3519070716ac'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (606e9bfd-e2ca-49d6-8565-9cb568579264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21e4e5a-d30b-456f-ae34-2450d67eb613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:06 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Delete snapshot completed successfully.
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21e4e5a-d30b-456f-ae34-2450d67eb613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-846506592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dd66fe-68ca-42f9-b325-5c4e69bc4053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:06Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1577d30-ad33-4cf7-bfd7-ce1fc8aaa229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1577d30-ad33-4cf7-bfd7-ce1fc8aaa229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e0e84a-8449-4510-97ef-4051fa7f47a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e0e84a-8449-4510-97ef-4051fa7f47a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dd66fe-68ca-42f9-b325-5c4e69bc4053', 'volume_name': 'volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d393e720-943a-4749-9bb5-3174367e2d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d393e720-943a-4749-9bb5-3174367e2d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b1d16c-0f49-40e5-a7db-bd744d3b8736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:06 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Volume a7dd66fe-68ca-42f9-b325-5c4e69bc4053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053', 'volume_size': 1}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-ff34225b-a944-4d86-a1ea-740f5b33b7c3 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-0772fd13-923b-4751-b6f0-74198f958384-delete_snapshot" released by "delete_snapshot" :: held 4.552s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:06 devstack sudo[111854]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67" returned: 0 in 0.700s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.031s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640988976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:49Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating volume 7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:06 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12524ff-5cc8-4e7c-bf6e-de04cb2e733b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:06 devstack sudo[111857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe 1073741824
Jun 16 19:00:06 devstack sudo[111857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e9bf73-d1f1-4c04-bd42-cb7c19c4edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:06 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 (4c6257a4-ed4b-4ebb-81db-9e44f97f9e67): created successfully
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e9bf73-d1f1-4c04-bd42-cb7c19c4edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:06 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (b72dfb0d-83df-419d-91f0-c2ef29cd884f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:06 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d592c7b1-ec40-498d-a2a9-a3a3feeb47e4 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created volume successfully.
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (feef6857-bba3-49ee-bf7b-47cd67a632c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974fb89c-2753-44da-99ba-ab55bc2dc7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974fb89c-2753-44da-99ba-ab55bc2dc7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780388148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15fefd5-f4b2-4a53-9483-554a5bc9af1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:07Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f044700a-7eec-4cbe-b27c-e8140f729019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f044700a-7eec-4cbe-b27c-e8140f729019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35899e57-a70f-40ea-84bb-d5db6553c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35899e57-a70f-40ea-84bb-d5db6553c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15fefd5-f4b2-4a53-9483-554a5bc9af1d', 'volume_name': 'volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0450bd-157e-44a7-a583-a64b6ab44a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0450bd-157e-44a7-a583-a64b6ab44a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3d4815-62ee-48c4-9d55-7056fa8afe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Volume f15fefd5-f4b2-4a53-9483-554a5bc9af1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d', 'volume_size': 1}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-f6b59e64-c173-4d29-ac0b-f4371a7032e1-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-f6b59e64-c173-4d29-ac0b-f4371a7032e1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (28b77306-1c8d-4c41-bffe-aaec3a38f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc2ccec-063a-4198-96d9-0dcc1b4cf8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-quobyte-f6b59e64-c173-4d29-ac0b-f4371a7032e1" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc2ccec-063a-4198-96d9-0dcc1b4cf8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968210770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945f80f5-d665-4378-936e-34da846ed316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:08Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5070dd5-698a-4437-9c06-55feaaf1b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5070dd5-698a-4437-9c06-55feaaf1b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e585fc53-f5a4-45f5-ab06-15e0c4de2d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e585fc53-f5a4-45f5-ab06-15e0c4de2d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945f80f5-d665-4378-936e-34da846ed316', 'volume_name': 'volume-945f80f5-d665-4378-936e-34da846ed316', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c52b138-9625-4d10-a458-bd7a81c1779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c52b138-9625-4d10-a458-bd7a81c1779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220a6105-f582-42f7-bce9-f38a2ca4833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:07 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Volume 945f80f5-d665-4378-936e-34da846ed316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945f80f5-d665-4378-936e-34da846ed316', 'volume_size': 1}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-f6b59e64-c173-4d29-ac0b-f4371a7032e1" acquired by "delete_volume" :: waited 0.067s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1122b9-6e8c-4e84-af9b-5318f1a2fbd2]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:07 devstack sudo[111857]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe 1073741824" returned: 0 in 1.033s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:07 devstack sudo[111863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1
Jun 16 19:00:07 devstack sudo[111863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:08 devstack sudo[111865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe
Jun 16 19:00:08 devstack sudo[111865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (038343c1-c2f0-44b3-8af0-17d4edbd480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba57aad1-5b8c-48c3-bbe7-fab3c419be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba57aad1-5b8c-48c3-bbe7-fab3c419be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439930085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771aee8d-2e3d-4494-97fb-0229fafb987a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:08Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a37cc3-902e-4f55-8a8d-94a57912f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a37cc3-902e-4f55-8a8d-94a57912f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236d0c72-1254-455e-9ad6-38fc7bd127b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236d0c72-1254-455e-9ad6-38fc7bd127b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771aee8d-2e3d-4494-97fb-0229fafb987a', 'volume_name': 'volume-771aee8d-2e3d-4494-97fb-0229fafb987a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305da091-9a6b-4452-a91f-47d94b7fc8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305da091-9a6b-4452-a91f-47d94b7fc8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a16c3d-9c11-4bb0-8a6b-ec4b4a2daf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Volume 771aee8d-2e3d-4494-97fb-0229fafb987a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771aee8d-2e3d-4494-97fb-0229fafb987a', 'volume_size': 1}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (78d02083-3768-494f-88af-660c48231047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40f1a63-7683-421f-a505-e895a3a30771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40f1a63-7683-421f-a505-e895a3a30771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2068500206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b019d7-986c-4f2f-a59d-090925cbffd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:09Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016a9f0e-d4dd-43b3-b558-bf7e96f7d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016a9f0e-d4dd-43b3-b558-bf7e96f7d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f1ef41-d769-4b8a-a5b5-f1033608b742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f1ef41-d769-4b8a-a5b5-f1033608b742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b019d7-986c-4f2f-a59d-090925cbffd1', 'volume_name': 'volume-b2b019d7-986c-4f2f-a59d-090925cbffd1', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e9d0a3-f08e-467f-ad52-a8fc909cf48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e9d0a3-f08e-467f-ad52-a8fc909cf48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3282924-cdef-47cc-8b4a-a41b28be29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Volume b2b019d7-986c-4f2f-a59d-090925cbffd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b019d7-986c-4f2f-a59d-090925cbffd1', 'volume_size': 1}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:08 devstack sudo[111865]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe" returned: 0 in 0.800s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.489s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T16:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134935938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d867f6fe-57e6-4847-b787-93bf1cb99c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995b985e6ee34cfa80106cae0605830f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T16:59:49Z,use_quota=True,user_id='8657c7077ba7420ba04b7061123cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Creating volume d867f6fe-57e6-4847-b787-93bf1cb99c7b {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:08 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:08 devstack sudo[111863]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c03e54-4068-4024-aa10-890c502149b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caccb33f-4315-432f-b0b9-251ab32a7131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1" returned: 0 in 1.033s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:08 devstack sudo[111871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b 1073741824
Jun 16 19:00:08 devstack sudo[111871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:08 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe (7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe): created successfully
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caccb33f-4315-432f-b0b9-251ab32a7131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:08 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (6ccd3385-ac5b-4e42-91c6-d6991fae1185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:08 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-9ef6c56e-40f7-4252-b67e-e801d81963ea tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created volume successfully.
Jun 16 19:00:08 devstack sudo[111873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1
Jun 16 19:00:08 devstack sudo[111873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:09 devstack sudo[111873]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f6b59e64-c173-4d29-ac0b-f4371a7032e1" returned: 0 in 0.673s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-f6b59e64-c173-4d29-ac0b-f4371a7032e1" released by "delete_volume" :: held 1.788s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Created reservations ['bcc2a56d-aa68-4811-a287-4ea935555ce4', '08c318f7-ff7c-44e8-b461-62358d54dfb8', 'bfa92b54-76ec-40f5-8a59-5472ff818523', '910e54d5-20f1-498d-8385-a2f317847b26'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:09 devstack sudo[111871]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b 1073741824" returned: 0 in 0.859s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:09 devstack sudo[111880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:09 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:09 devstack sudo[111882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b
Jun 16 19:00:09 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-a6b32e75-32c8-47b6-aa54-dc488e92567e-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-a6b32e75-32c8-47b6-aa54-dc488e92567e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "cinder-quobyte-a6b32e75-32c8-47b6-aa54-dc488e92567e" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-a6b32e75-32c8-47b6-aa54-dc488e92567e" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a94f8ce-5dff-4b03-a7af-5132d345609e]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:09 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:10 devstack sudo[111884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e
Jun 16 19:00:10 devstack sudo[111884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:10 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.697s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Deleted volume successfully.
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-a435dede-e153-41fb-b30e-ad9dd52a7ab8 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-f6b59e64-c173-4d29-ac0b-f4371a7032e1-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:10 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b" returned: 0 in 0.714s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.770s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-846506592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dd66fe-68ca-42f9-b325-5c4e69bc4053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:06Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Creating volume a7dd66fe-68ca-42f9-b325-5c4e69bc4053 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:10 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e25cc-0b64-48ea-a4b6-dc5aedf29132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69dfe97-5fe7-4e8c-aa50-aae718aaaa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:10 devstack sudo[111889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 1073741824
Jun 16 19:00:10 devstack sudo[111889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:10 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Volume volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b (d867f6fe-57e6-4847-b787-93bf1cb99c7b): created successfully
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69dfe97-5fe7-4e8c-aa50-aae718aaaa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Flow 'volume_create_manager' (a5e2dc98-11f9-4e37-922d-f058962e5f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:10 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-ff1ec7db-5c12-4793-bdae-45c26481b373 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created volume successfully.
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-d867f6fe-57e6-4847-b787-93bf1cb99c7b-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-d867f6fe-57e6-4847-b787-93bf1cb99c7b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-d867f6fe-57e6-4847-b787-93bf1cb99c7b" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:10 devstack sudo[111884]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-d867f6fe-57e6-4847-b787-93bf1cb99c7b" acquired by "delete_volume" :: waited 0.032s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e" returned: 0 in 0.834s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ac406b-e5f5-40f4-a4c1-63f5685e3a41]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:10 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:10 devstack sudo[111894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e
Jun 16 19:00:10 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:10 devstack sudo[111896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b
Jun 16 19:00:10 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:11 devstack sudo[111889]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 1073741824" returned: 0 in 0.966s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:11 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:11 devstack sudo[111903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a6b32e75-32c8-47b6-aa54-dc488e92567e" returned: 0 in 0.691s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:11 devstack sudo[111903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-quobyte-a6b32e75-32c8-47b6-aa54-dc488e92567e" released by "delete_volume" :: held 1.589s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Created reservations ['5c9d9fe7-17e5-412f-8624-86a5985036d6', '5dac5f12-8e70-4555-99f1-72b3e5efb127', '4b126f6f-05fe-43ea-8236-417e56b8c6e2', 'c7e22b79-c2e3-4adb-a42a-90a81be5aa37'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Flow 'volume_create_manager' (67deda06-b63d-48b1-99f6-b864b8b807fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e1cf5b-9a1b-4b90-a999-f3456a25b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e1cf5b-9a1b-4b90-a999-f3456a25b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1e210c-bd94-4099-af3e-dce0ff11ea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47acdc61f2b64ccbbccca18c3923634a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:12Z,use_quota=True,user_id='0ee9256343ae48f8bc533c134da3cdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61521e9c-0e5e-47e3-badc-c973795f6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61521e9c-0e5e-47e3-badc-c973795f6c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82770f21-03c5-4bd2-9b46-beabd7001690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.image.glance [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Creating Keystone auth plugin from conf {{(pid=91851) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 16 19:00:11 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b" returned: 0 in 0.906s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:11 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:11 devstack sudo[111908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b
Jun 16 19:00:11 devstack sudo[111908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:11 devstack sudo[111909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:11 devstack sudo[111909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82770f21-03c5-4bd2-9b46-beabd7001690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c1e210c-bd94-4099-af3e-dce0ff11ea56', 'volume_name': 'volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56', 'volume_size': 1, 'image_id': '855ca166-1591-40ff-8d73-f13a3606daca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/855ca166-1591-40ff-8d73-f13a3606daca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1b26167b1041a9d342362dfe639eb54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47acdc61f2b64ccbbccca18c3923634a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33340eb4f55132973f496ec7c7de1a15d80d29ab77b76a7506b0e32ae0a11a21cfe7af6c5dac44a19f2bbb23ff84df491ab2e9c98627a7042b42951cbeaf0682', 'id': '855ca166-1591-40ff-8d73-f13a3606daca', 'created_at': datetime.datetime(2026, 6, 16, 17, 0, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 17, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/855ca166-1591-40ff-8d73-f13a3606daca/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b648590>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b247c6f7-3ab3-4d5a-8444-cd2f54f5459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b247c6f7-3ab3-4d5a-8444-cd2f54f5459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98513385-1d3b-4d75-982f-0a98f23f04d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:12 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Volume 8c1e210c-bd94-4099-af3e-dce0ff11ea56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56', 'volume_size': 1, 'image_id': '855ca166-1591-40ff-8d73-f13a3606daca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/855ca166-1591-40ff-8d73-f13a3606daca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1b26167b1041a9d342362dfe639eb54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47acdc61f2b64ccbbccca18c3923634a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33340eb4f55132973f496ec7c7de1a15d80d29ab77b76a7506b0e32ae0a11a21cfe7af6c5dac44a19f2bbb23ff84df491ab2e9c98627a7042b42951cbeaf0682', 'id': '855ca166-1591-40ff-8d73-f13a3606daca', 'created_at': datetime.datetime(2026, 6, 16, 17, 0, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 17, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/855ca166-1591-40ff-8d73-f13a3606daca/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b648590>}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Trying to clone 8c1e210c-bd94-4099-af3e-dce0ff11ea56 from image 855ca166-1591-40ff-8d73-f13a3606daca at location (None, [{'url': 'file:///opt/stack/data/glance/images/855ca166-1591-40ff-8d73-f13a3606daca', 'metadata': {}}]). {{(pid=91851) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jun 16 19:00:12 devstack sudo[111903]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053" returned: 0 in 0.718s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.846s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780388148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15fefd5-f4b2-4a53-9483-554a5bc9af1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:07Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Creating volume f15fefd5-f4b2-4a53-9483-554a5bc9af1d {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:12 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 16 19:00:12 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Image download 0.00 MB at 0.00 MB/s
Jun 16 19:00:12 devstack sudo[111913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d 1073741824
Jun 16 19:00:12 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b1d16c-0f49-40e5-a7db-bd744d3b8736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1381bf-9d43-41e7-86c8-6f2ab8ca013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:12 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Volume volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 (a7dd66fe-68ca-42f9-b325-5c4e69bc4053): created successfully
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1381bf-9d43-41e7-86c8-6f2ab8ca013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (606e9bfd-e2ca-49d6-8565-9cb568579264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-3bf09015-8810-443e-a3ea-010e2eb8c10f tempest-CreateVolumesFromImageTest-531029816 None] Created volume successfully.
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ee892-6415-4d04-b8c2-e85b869b3e13]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:12 devstack sudo[111908]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-d867f6fe-57e6-4847-b787-93bf1cb99c7b" returned: 0 in 0.723s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-d867f6fe-57e6-4847-b787-93bf1cb99c7b" released by "delete_volume" :: held 1.709s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:12 devstack sudo[111916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD
Jun 16 19:00:12 devstack sudo[111916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:12 devstack sudo[111909]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.789s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:12 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Deleted volume successfully.
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['b653b07c-a9a7-4ef2-8cfe-b67250a0e2ee', '9083444d-6351-412c-92f9-0f1f6dc34269', 'e06f72c2-9c04-4168-9946-aa94e8064d05', '4acb6d33-9e15-4410-8d91-4a1c1d41f260'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7508e8b4-ff0c-42c5-b3ff-aac72b1f12e5 tempest-CinderUnicodeTest-1663481298 None] Lock "cinder-a6b32e75-32c8-47b6-aa54-dc488e92567e-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:12 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:12 devstack sudo[111919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:12 devstack sudo[111919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64cba2e-885e-4016-a1e6-71b414ad192d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:13 devstack sudo[111924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe
Jun 16 19:00:13 devstack sudo[111924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:13 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d 1073741824" returned: 0 in 1.235s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:13 devstack sudo[111916]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD" returned: 0 in 1.091s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:13 devstack sudo[111930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d
Jun 16 19:00:13 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:13 devstack sudo[111919]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.863s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:13 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleted volume successfully.
Jun 16 19:00:13 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-87ab4dd0-e326-4e28-b70c-f4daf52ec1af tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-d867f6fe-57e6-4847-b787-93bf1cb99c7b-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:13 devstack sudo[111929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD
Jun 16 19:00:13 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:14 devstack sudo[111924]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe" returned: 0 in 0.894s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:14 devstack sudo[111938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe
Jun 16 19:00:14 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:14 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d" returned: 0 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.590s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968210770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945f80f5-d665-4378-936e-34da846ed316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:08Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Creating volume 945f80f5-d665-4378-936e-34da846ed316 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:14 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:14 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:14 devstack sudo[111943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316 1073741824
Jun 16 19:00:14 devstack sudo[111943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3d4815-62ee-48c4-9d55-7056fa8afe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b12ea8-a2c2-4e1e-bd76-d81239e2a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD" returned: 1 in 0.917s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Temporary image 855ca166-1591-40ff-8d73-f13a3606daca is fetched for user 0ee9256343ae48f8bc533c134da3cdae. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 16 19:00:14 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Volume volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d (f15fefd5-f4b2-4a53-9483-554a5bc9af1d): created successfully
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b12ea8-a2c2-4e1e-bd76-d81239e2a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (feef6857-bba3-49ee-bf7b-47cd67a632c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:14 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d87a0060-8d75-44ac-9afa-ddb2f99151fc tempest-CreateVolumesFromImageTest-531029816 None] Created volume successfully.
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[1743c237-e451-474b-ab67-2837c43fc08e]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:14 devstack sudo[111945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD
Jun 16 19:00:14 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:14 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe" returned: 0 in 0.817s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:14 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe" released by "delete_volume" :: held 1.773s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['824f08f0-fa6a-4ae1-b921-fff84d066549', '19f03024-b9b2-4ba9-8c64-332b0b8ef440', 'a66a4490-66cd-4f77-8231-1df7a711488a', 'c3b96bee-9f8f-45ea-9522-b45e5905eb40'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:15 devstack sudo[111952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:15 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:15 devstack sudo[111943]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316 1073741824" returned: 0 in 0.894s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:15 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:15 devstack sudo[111956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316
Jun 16 19:00:15 devstack sudo[111956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:15 devstack sudo[111957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD
Jun 16 19:00:15 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a365c6f1-6dbe-40f6-9649-5d7f9b48ddc8]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:15 devstack sudo[111960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67
Jun 16 19:00:15 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:15 devstack sudo[111956]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316" returned: 0 in 0.727s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.606s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439930085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771aee8d-2e3d-4494-97fb-0229fafb987a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:08Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Creating volume 771aee8d-2e3d-4494-97fb-0229fafb987a {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:15 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:15 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:15 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.917s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:16 devstack sudo[111964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a 1073741824
Jun 16 19:00:16 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220a6105-f582-42f7-bce9-f38a2ca4833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945f80f5-d665-4378-936e-34da846ed316', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b928d002-521d-41c3-b508-82aec61400ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleted volume successfully.
Jun 16 19:00:16 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Volume volume-945f80f5-d665-4378-936e-34da846ed316 (945f80f5-d665-4378-936e-34da846ed316): created successfully
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b928d002-521d-41c3-b508-82aec61400ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (28b77306-1c8d-4c41-bffe-aaec3a38f03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-82bc859c-83ca-4612-b0c7-64e1d9f36636 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-7ebfdb41-6fb5-40a2-bcf1-e084b5f43bfe-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:16 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-40e023c5-4c99-433e-bd37-326995c09f6a tempest-CreateVolumesFromImageTest-531029816 None] Created volume successfully.
Jun 16 19:00:16 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD" returned: 1 in 1.065s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:16 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67" returned: 0 in 1.079s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:16 devstack sudo[111975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67
Jun 16 19:00:16 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:16 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:16 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a 1073741824" returned: 0 in 0.992s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:17 devstack sudo[111978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a
Jun 16 19:00:17 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:17 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67" returned: 0 in 0.659s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67" released by "delete_volume" :: held 1.799s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['e39af1af-b9e9-42ca-989c-8287dba9d70d', '75088772-a25a-479b-a088-9acd0648f4de', 'c57139de-bb4f-44bd-88d0-acbf6eec2d26', 'ce8cd431-c1a9-4234-ae9e-0df45f97a169'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:17 devstack sudo[111981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:17 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:17 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a" returned: 0 in 0.616s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.894s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2068500206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b019d7-986c-4f2f-a59d-090925cbffd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5270d9dadb446bab100e6045e6225d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:09Z,use_quota=True,user_id='7081b45198e24942a3fec11034109d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Creating volume b2b019d7-986c-4f2f-a59d-090925cbffd1 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:17 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:17 devstack sudo[111984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 1073741824
Jun 16 19:00:17 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a16c3d-9c11-4bb0-8a6b-ec4b4a2daf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771aee8d-2e3d-4494-97fb-0229fafb987a', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a995e2e3-031b-45a9-b014-c059ec6fe17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:17 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Volume volume-771aee8d-2e3d-4494-97fb-0229fafb987a (771aee8d-2e3d-4494-97fb-0229fafb987a): created successfully
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a995e2e3-031b-45a9-b014-c059ec6fe17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (038343c1-c2f0-44b3-8af0-17d4edbd480d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:17 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7cf81da6-5594-4a35-9821-1054813cebf5 tempest-CreateVolumesFromImageTest-531029816 None] Created volume successfully.
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-0dbc1fd8-f40f-4a9b-94b6-599f76253541-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-0dbc1fd8-f40f-4a9b-94b6-599f76253541-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:17 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-0dbc1fd8-f40f-4a9b-94b6-599f76253541" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-0dbc1fd8-f40f-4a9b-94b6-599f76253541" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f00bef-f8d1-467d-9325-3a533e96053f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:18 devstack sudo[111986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541
Jun 16 19:00:18 devstack sudo[111986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:18 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.715s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:18 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleted volume successfully.
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e2d036d4-3aec-4feb-97f6-b8e5d97d02ee tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-4c6257a4-ed4b-4ebb-81db-9e44f97f9e67-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:18 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 1073741824" returned: 0 in 0.901s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:18 devstack sudo[111992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1
Jun 16 19:00:18 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:18 devstack sudo[111986]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541" returned: 0 in 0.784s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:18 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:18 devstack sudo[111997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541
Jun 16 19:00:18 devstack sudo[111997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:19 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1" returned: 0 in 0.679s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1e210c-bd94-4099-af3e-dce0ff11ea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47acdc61f2b64ccbbccca18c3923634a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:12Z,use_quota=True,user_id='0ee9256343ae48f8bc533c134da3cdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Creating volume 8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:19 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3282924-cdef-47cc-8b4a-a41b28be29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b019d7-986c-4f2f-a59d-090925cbffd1', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:19 devstack sudo[112000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 1073741824
Jun 16 19:00:19 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69387d2c-e4c9-4a64-bd21-a9bdf970db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:19 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Volume volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 (b2b019d7-986c-4f2f-a59d-090925cbffd1): created successfully
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69387d2c-e4c9-4a64-bd21-a9bdf970db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Flow 'volume_create_manager' (78d02083-3768-494f-88af-660c48231047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:19 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-6947f165-e32d-41e4-8fbc-53f2c1203e02 tempest-CreateVolumesFromImageTest-531029816 None] Created volume successfully.
Jun 16 19:00:19 devstack sudo[111997]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-0dbc1fd8-f40f-4a9b-94b6-599f76253541" returned: 0 in 0.669s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-0dbc1fd8-f40f-4a9b-94b6-599f76253541" released by "delete_volume" :: held 1.506s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['f0c11d4d-7ef0-4923-bd09-38d39d9fa72d', '7bf6892d-6b2a-4bd1-988a-7b0856b8b73a', 'cbad8ab6-83fa-4335-a391-3f1d98672eee', '9105def6-9d0a-485c-bb0d-66a0b3279017'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:19 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:19 devstack sudo[112003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:19 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-b2b019d7-986c-4f2f-a59d-090925cbffd1-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-b7f0fff1-e0b6-419a-80aa-ffde06860d9e-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-b2b019d7-986c-4f2f-a59d-090925cbffd1-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-b7f0fff1-e0b6-419a-80aa-ffde06860d9e-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-quobyte-b2b019d7-986c-4f2f-a59d-090925cbffd1" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-b7f0fff1-e0b6-419a-80aa-ffde06860d9e" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-b2b019d7-986c-4f2f-a59d-090925cbffd1" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:20 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 1073741824" returned: 0 in 1.039s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-b7f0fff1-e0b6-419a-80aa-ffde06860d9e" acquired by "delete_volume" :: waited 0.053s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf469754-89cb-4bbe-93bc-667f9f20a213]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:20 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b6a05d-addf-4b2f-ad41-b3846470cd0c]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.780s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:20 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleted volume successfully.
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:20 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fd6a73fb-8af0-4c4f-aa79-d201c9516ce3 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-0dbc1fd8-f40f-4a9b-94b6-599f76253541-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:20 devstack sudo[112013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:20 devstack sudo[112013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:20 devstack sudo[112011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1
Jun 16 19:00:20 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:20 devstack sudo[112012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e
Jun 16 19:00:20 devstack sudo[112012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:21 devstack sudo[112013]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 0 in 0.770s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Attempting download of 855ca166-1591-40ff-8d73-f13a3606daca ((None, [{'url': 'file:///opt/stack/data/glance/images/855ca166-1591-40ff-8d73-f13a3606daca', 'metadata': {}}])) to volume 8c1e210c-bd94-4099-af3e-dce0ff11ea56. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e46b97-2145-48a4-b3b8-6294e75ce128]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:21 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:21 devstack sudo[112012]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1" returned: 0 in 1.026s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e" returned: 0 in 1.018s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:21 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:21 devstack sudo[112025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1
Jun 16 19:00:21 devstack sudo[112025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:21 devstack sudo[112026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e
Jun 16 19:00:21 devstack sudo[112026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:21 devstack sudo[112024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s
Jun 16 19:00:21 devstack sudo[112024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:22 devstack sudo[112025]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b2b019d7-986c-4f2f-a59d-090925cbffd1" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-b2b019d7-986c-4f2f-a59d-090925cbffd1" released by "delete_volume" :: held 1.821s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:22 devstack sudo[112024]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s" returned: 0 in 0.828s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:22 devstack sudo[112026]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b7f0fff1-e0b6-419a-80aa-ffde06860d9e" returned: 0 in 0.802s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Created reservations ['f594f269-ab01-41e4-90e6-734c0d35cf5b', '6716b677-5658-450a-b44a-e0ec2273ed49', '87314f61-0bc3-4298-9c06-37666a4f528c', '43671fbd-38cf-42e6-baee-4390003056e7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-b7f0fff1-e0b6-419a-80aa-ffde06860d9e" released by "delete_volume" :: held 1.875s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:22 devstack sudo[112040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s
Jun 16 19:00:22 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['c70b91b0-e480-4bc9-860f-44c1736b2783', '8b17a9b8-08ff-4bf5-9b74-010cadcec4ea', '6aa98208-29a1-4e91-91d5-c04d047ab561', '74eed027-1cab-48f9-8858-0cb562ad3262'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:22 devstack sudo[112042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:22 devstack sudo[112042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:22 devstack sudo[112044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:22 devstack sudo[112044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-771aee8d-2e3d-4494-97fb-0229fafb987a-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-771aee8d-2e3d-4494-97fb-0229fafb987a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-quobyte-771aee8d-2e3d-4494-97fb-0229fafb987a" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-771aee8d-2e3d-4494-97fb-0229fafb987a" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1abf747-cf40-4b07-8b54-378cbebec3b1]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:22 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:22 devstack sudo[112046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a
Jun 16 19:00:22 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:23 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s" returned: 1 in 0.868s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_855ca166-1591-40ff-8d73-f13a3606daca_l58yih2s' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fb26ea-7369-40e0-869a-f2176a6ef9ac]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:23 devstack sudo[112042]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.834s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:23 devstack sudo[112044]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.704s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Deleted volume successfully.
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-787ea7b4-c2fa-4346-8088-132bed4fa81c tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-b2b019d7-986c-4f2f-a59d-090925cbffd1-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:23 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleted volume successfully.
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-45e48210-4cb8-4adf-bdb7-760ce30082ec tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-b7f0fff1-e0b6-419a-80aa-ffde06860d9e-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:23 devstack sudo[112051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD
Jun 16 19:00:23 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-d269c4ae-b66f-4d85-a4d6-c5660d017755-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-d269c4ae-b66f-4d85-a4d6-c5660d017755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-172f7932-827a-4974-9a5b-f7b843a3b3c5" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-172f7932-827a-4974-9a5b-f7b843a3b3c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-d269c4ae-b66f-4d85-a4d6-c5660d017755" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-d269c4ae-b66f-4d85-a4d6-c5660d017755" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleting offline snapshot d269c4ae-b66f-4d85-a4d6-c5660d017755 of volume 172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] snapshot_file for this snap is: volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65b07cc-cdfa-4c14-ad65-da4a1c348320]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:23 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a" returned: 0 in 1.037s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:23 devstack sudo[112058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a
Jun 16 19:00:23 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:23 devstack sudo[112057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755
Jun 16 19:00:23 devstack sudo[112057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:23 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:23 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:24 devstack sudo[112063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD
Jun 16 19:00:24 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:24 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-771aee8d-2e3d-4494-97fb-0229fafb987a" returned: 0 in 0.633s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-771aee8d-2e3d-4494-97fb-0229fafb987a" released by "delete_volume" :: held 1.731s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Created reservations ['afc717d8-42ce-4818-98a3-8fbbfc464c26', '830e74dc-97ba-4af4-bfbb-85ebe5c479c3', 'cfcee2b2-29e0-4e4e-a5f2-5e16320d28b0', '733c48a4-9891-4df6-a0f7-d007cddd6c36'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:24 devstack sudo[112057]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755" returned: 0 in 0.800s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-172f7932-827a-4974-9a5b-f7b843a3b3c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582269e-2b21-4da1-b986-7b3ffd1c8250]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:24 devstack sudo[112074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:24 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:24 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] 855ca166-1591-40ff-8d73-f13a3606daca was raw, converting to raw {{(pid=91851) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:24 devstack sudo[112070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5
Jun 16 19:00:24 devstack sudo[112070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:24 devstack sudo[112076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:24 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-945f80f5-d665-4378-936e-34da846ed316-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:24 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-945f80f5-d665-4378-936e-34da846ed316-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-quobyte-945f80f5-d665-4378-936e-34da846ed316" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-945f80f5-d665-4378-936e-34da846ed316" acquired by "delete_volume" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[be49b152-bed0-4a5b-9e9c-5ead21f82f3b]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:25 devstack sudo[112079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316
Jun 16 19:00:25 devstack sudo[112079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:25 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.925s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:25 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Deleted volume successfully.
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d8547265-4ef3-4a86-a841-29e7144e04eb tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-771aee8d-2e3d-4494-97fb-0229fafb987a-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:25 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 0 in 0.848s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_855ca166-1591-40ff-8d73-f13a3606daca_xsunia1udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 19:00:25 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Converted 0.00 MB image at 0.00 MB/s
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:25 devstack sudo[112088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 1G
Jun 16 19:00:25 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:25 devstack sudo[112070]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5" returned: 0 in 1.140s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:25 devstack sudo[112090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755
Jun 16 19:00:25 devstack sudo[112090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:25 devstack sudo[112079]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316" returned: 0 in 0.848s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:25 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:26 devstack sudo[112097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316
Jun 16 19:00:26 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:26 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 1G" returned: 0 in 0.840s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a9257-03ca-49bd-934d-a8346439b8c7]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:26 devstack sudo[112090]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755" returned: 0 in 0.892s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:26 devstack sudo[112106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:26 devstack sudo[112106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:26 devstack sudo[112107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755
Jun 16 19:00:26 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:26 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-945f80f5-d665-4378-936e-34da846ed316" returned: 0 in 0.789s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-945f80f5-d665-4378-936e-34da846ed316" released by "delete_volume" :: held 1.685s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:26 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Created reservations ['132a3803-94ec-45ee-923e-6442a14eb012', '0a1103d6-455d-4e10-8b0c-53707e32d619', 'af192b3f-be46-4f13-bc06-f013a6fe75f7', 'c36d2e64-2d1b-40be-8ee4-9c1b66c68e73'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:27 devstack sudo[112111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:27 devstack sudo[112111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-f15fefd5-f4b2-4a53-9483-554a5bc9af1d-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-f15fefd5-f4b2-4a53-9483-554a5bc9af1d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-quobyte-f15fefd5-f4b2-4a53-9483-554a5bc9af1d" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-f15fefd5-f4b2-4a53-9483-554a5bc9af1d" acquired by "delete_volume" :: waited 0.023s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460d89a-61e1-49ca-8178-dd8da29107dc]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:27 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5.d269c4ae-b66f-4d85-a4d6-c5660d017755" returned: 0 in 0.948s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-d269c4ae-b66f-4d85-a4d6-c5660d017755" released by "_delete_snapshot" :: held 3.943s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-172f7932-827a-4974-9a5b-f7b843a3b3c5" released by "delete_snapshot" :: held 3.985s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:27 devstack sudo[112114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d
Jun 16 19:00:27 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['2a309103-123d-482d-9abd-deeb5fdc6623', 'a3d9e2b5-c763-4f8a-bc24-8dbab2598eba', '1a1ef2df-61c6-47f6-9634-9aba30397a85', 'f8b2c69b-3464-42ea-b694-590ed00b0ab3'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:27 devstack sudo[112106]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 0 in 1.293s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:27 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Delete snapshot completed successfully.
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e46ee34c-6059-4f66-bcca-b2e4fbb9d1e1 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-d269c4ae-b66f-4d85-a4d6-c5660d017755-delete_snapshot" released by "delete_snapshot" :: held 4.248s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:27 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-172f7932-827a-4974-9a5b-f7b843a3b3c5-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:27 devstack sudo[112118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:27 devstack sudo[112118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-172f7932-827a-4974-9a5b-f7b843a3b3c5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "cinder-quobyte-172f7932-827a-4974-9a5b-f7b843a3b3c5" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:28 devstack sudo[112111]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.035s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-172f7932-827a-4974-9a5b-f7b843a3b3c5" acquired by "delete_volume" :: waited 0.033s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:28 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Deleted volume successfully.
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e548758-da90-4e4f-b923-e2f4dd279b38]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8d0dc07c-b3b9-4bb0-872a-b7db33332008 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-945f80f5-d665-4378-936e-34da846ed316-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:28 devstack sudo[112121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5
Jun 16 19:00:28 devstack sudo[112121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:28 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d" returned: 0 in 1.049s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:28 devstack sudo[112126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d
Jun 16 19:00:28 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:28 devstack sudo[112118]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 1 in 1.081s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Downloaded image 855ca166-1591-40ff-8d73-f13a3606daca ((None, [{'url': 'file:///opt/stack/data/glance/images/855ca166-1591-40ff-8d73-f13a3606daca', 'metadata': {}}])) to volume 8c1e210c-bd94-4099-af3e-dce0ff11ea56 successfully. {{(pid=91851) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Temporary image 855ca166-1591-40ff-8d73-f13a3606daca for user 0ee9256343ae48f8bc533c134da3cdae is deleted. {{(pid=91851) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.volume_utils [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Marking volume 8c1e210c-bd94-4099-af3e-dce0ff11ea56 as bootable. {{(pid=91851) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Copying metadata from image 855ca166-1591-40ff-8d73-f13a3606daca to 8c1e210c-bd94-4099-af3e-dce0ff11ea56. {{(pid=91851) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Creating volume glance metadata for volume 8c1e210c-bd94-4099-af3e-dce0ff11ea56 backed by image 855ca166-1591-40ff-8d73-f13a3606daca with: {'image_id': '855ca166-1591-40ff-8d73-f13a3606daca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a1b26167b1041a9d342362dfe639eb54', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91851) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98513385-1d3b-4d75-982f-0a98f23f04d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56', 'volume_size': 1, 'image_id': '855ca166-1591-40ff-8d73-f13a3606daca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/855ca166-1591-40ff-8d73-f13a3606daca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1b26167b1041a9d342362dfe639eb54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47acdc61f2b64ccbbccca18c3923634a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33340eb4f55132973f496ec7c7de1a15d80d29ab77b76a7506b0e32ae0a11a21cfe7af6c5dac44a19f2bbb23ff84df491ab2e9c98627a7042b42951cbeaf0682', 'id': '855ca166-1591-40ff-8d73-f13a3606daca', 'created_at': datetime.datetime(2026, 6, 16, 17, 0, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 17, 0, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/855ca166-1591-40ff-8d73-f13a3606daca/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72545b648590>}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d543c5-571c-4ef0-8b68-d6a26a26ea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:28 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Volume volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 (8c1e210c-bd94-4099-af3e-dce0ff11ea56): created successfully
Jun 16 19:00:28 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d543c5-571c-4ef0-8b68-d6a26a26ea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Flow 'volume_create_manager' (67deda06-b63d-48b1-99f6-b864b8b807fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:29 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b74b3ac3-d170-4ed6-91eb-b66fffe35f34 tempest-VolumeImageDependencyTests-1045605435 None] Created volume successfully.
Jun 16 19:00:29 devstack sudo[112121]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5" returned: 0 in 0.864s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:29 devstack sudo[112136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5
Jun 16 19:00:29 devstack sudo[112136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:29 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-f15fefd5-f4b2-4a53-9483-554a5bc9af1d" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-f15fefd5-f4b2-4a53-9483-554a5bc9af1d" released by "delete_volume" :: held 1.841s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Acquiring lock "cinder-8c1e210c-bd94-4099-af3e-dce0ff11ea56-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Created reservations ['1ddf506c-e512-4fc8-bc27-36049fb482d5', '1e75f84d-37bf-4d73-b057-42d09a5d231e', '86b40191-2622-451c-a0f4-787a0d09f64d', 'b35ae09e-b730-4cca-9f64-b09fc096312d'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Lock "cinder-8c1e210c-bd94-4099-af3e-dce0ff11ea56-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Acquiring lock "cinder-quobyte-8c1e210c-bd94-4099-af3e-dce0ff11ea56" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Lock "cinder-quobyte-8c1e210c-bd94-4099-af3e-dce0ff11ea56" acquired by "delete_volume" :: waited 0.026s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[06006702-9c85-454e-b945-548a9345125d]: (4, 'raw') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:29 devstack sudo[112138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:29 devstack sudo[112138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-a7dd66fe-68ca-42f9-b325-5c4e69bc4053-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-a7dd66fe-68ca-42f9-b325-5c4e69bc4053-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:29 devstack sudo[112139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:29 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "cinder-quobyte-a7dd66fe-68ca-42f9-b325-5c4e69bc4053" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-a7dd66fe-68ca-42f9-b325-5c4e69bc4053" acquired by "delete_volume" :: waited 0.029s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c3a78d-a4e8-47cb-9f8a-7dfe701c9e8f]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:29 devstack sudo[112136]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-172f7932-827a-4974-9a5b-f7b843a3b3c5" returned: 0 in 0.748s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-quobyte-172f7932-827a-4974-9a5b-f7b843a3b3c5" released by "delete_volume" :: held 1.737s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:29 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Created reservations ['38734ade-b198-46e3-a97e-0cf3c4795549', '1fef7d6a-6ef5-463b-9cf9-b69ab64be3d2', '5ac58faf-5ef9-4094-bf01-769e4f6d7204', '65cf1a70-56e9-4467-98ce-514c388bdc58'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:29 devstack sudo[112143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053
Jun 16 19:00:29 devstack sudo[112143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:30 devstack sudo[112146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:30 devstack sudo[112146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:30 devstack sudo[112138]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.045s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Deleted volume successfully.
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-af47c09c-762e-427e-9cd6-828386467753 tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-f15fefd5-f4b2-4a53-9483-554a5bc9af1d-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:30 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 0 in 1.199s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:30 devstack sudo[112151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:30 devstack sudo[112151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:30 devstack sudo[112146]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.829s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:30 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Deleted volume successfully.
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=157,cinder:UPDATE=207,cinder:DELETE=16,cinder:INSERT=47 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 19:00:30 devstack sudo[112143]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053" returned: 0 in 1.219s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:30 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-e1a85c6d-f2ef-4eac-abd2-cba16ba61269 tempest-CreateVolumesFromSnapshotTest-1903054397 None] Lock "cinder-172f7932-827a-4974-9a5b-f7b843a3b3c5-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:31 devstack sudo[112157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053
Jun 16 19:00:31 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:31 devstack sudo[112151]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 1 in 0.999s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56' failed. Not Retrying. {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:31 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a7dd66fe-68ca-42f9-b325-5c4e69bc4053" returned: 0 in 0.737s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-quobyte-a7dd66fe-68ca-42f9-b325-5c4e69bc4053" released by "delete_volume" :: held 2.013s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:31 devstack sudo[112163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56
Jun 16 19:00:31 devstack sudo[112163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:UPDATE=183,cinder:SELECT=144,cinder:INSERT=63,cinder:DELETE=19 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Created reservations ['829380f3-8f2a-4dfe-9963-cf4d94068def', 'a4c29aae-3c2b-49b4-a534-7a623e617ca4', 'f56d5f09-6091-4664-bd97-59a1f018c682', '52e42a69-70d0-4d35-91d6-97013d6d247f'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:31 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:32 devstack sudo[112165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:32 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:32 devstack sudo[112163]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-8c1e210c-bd94-4099-af3e-dce0ff11ea56" returned: 0 in 0.822s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Lock "cinder-quobyte-8c1e210c-bd94-4099-af3e-dce0ff11ea56" released by "delete_volume" :: held 3.132s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Created reservations ['e817dc8b-598b-4b6d-a60a-eeb59048d529', 'ee6a4421-1836-46ca-9ea3-c30228a1bcf7', '8c2a58a9-39c0-40f3-af80-fd02291e10e1', 'f9003c64-71bb-4e37-aaae-4fbb6b94f808'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:32 devstack sudo[112169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:32 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:32 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.830s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:32 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Deleted volume successfully.
Jun 16 19:00:32 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-d5858c52-b8df-49d1-abe9-709f75db709f tempest-CreateVolumesFromImageTest-531029816 None] Lock "cinder-a7dd66fe-68ca-42f9-b325-5c4e69bc4053-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:33 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:33 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.858s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:33 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:33 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Deleted volume successfully.
Jun 16 19:00:33 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-fc7e3215-229b-4a76-9634-dd28009d8d48 tempest-VolumeImageDependencyTests-1045605435 None] Lock "cinder-8c1e210c-bd94-4099-af3e-dce0ff11ea56-delete_volume" released by "delete_volume" :: held 4.345s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (46fc881c-2e17-4218-9b42-ce75f2a2eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6af132-13f9-4188-9abe-af76870ce2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6af132-13f9-4188-9abe-af76870ce2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324505509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d510dd5-5fbc-4c34-8c2c-b32520153b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:35Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6073fac0-9892-4224-a9e0-ca4e7ef02843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6073fac0-9892-4224-a9e0-ca4e7ef02843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54932dbb-e470-4320-bc3e-6457398d8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54932dbb-e470-4320-bc3e-6457398d8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d510dd5-5fbc-4c34-8c2c-b32520153b1b', 'volume_name': 'volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6771ff8c-f2a6-4f22-a5a1-27f886e9291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6771ff8c-f2a6-4f22-a5a1-27f886e9291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256d5705-51f3-46b5-857c-7239a258e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:34 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume 4d510dd5-5fbc-4c34-8c2c-b32520153b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b', 'volume_size': 1}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324505509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d510dd5-5fbc-4c34-8c2c-b32520153b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:35Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Creating volume 4d510dd5-5fbc-4c34-8c2c-b32520153b1b {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:34 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:34 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:34 devstack sudo[112209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b 1073741824
Jun 16 19:00:34 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:35 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b 1073741824" returned: 0 in 0.927s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:35 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:35 devstack sudo[112215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b
Jun 16 19:00:35 devstack sudo[112215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:36 devstack sudo[112215]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b" returned: 0 in 0.660s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256d5705-51f3-46b5-857c-7239a258e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f3e9d5-440f-40b8-a5b4-4d0700505e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:36 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b (4d510dd5-5fbc-4c34-8c2c-b32520153b1b): created successfully
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f3e9d5-440f-40b8-a5b4-4d0700505e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:36 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (46fc881c-2e17-4218-9b42-ce75f2a2eabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:36 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-e8365e32-3e52-4d52-9c73-15c6c050e69c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created volume successfully.
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (4a5f6ab2-bdb8-48cd-a554-6d5fd62a5e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d577398-7d09-47c8-9bad-bad2dbd28bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d577398-7d09-47c8-9bad-bad2dbd28bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628610242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddeba67-d489-4046-b964-f8610d602358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:37Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ba5e6-4032-4602-96ea-9a5867ce76c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ba5e6-4032-4602-96ea-9a5867ce76c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e16c68a-8093-494e-83e3-0464075b997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e16c68a-8093-494e-83e3-0464075b997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddeba67-d489-4046-b964-f8610d602358', 'volume_name': 'volume-7ddeba67-d489-4046-b964-f8610d602358', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0914070d-6cb5-447b-90d1-b93818efcf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0914070d-6cb5-447b-90d1-b93818efcf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb0fed9-0229-4fd1-8229-2c2cb1358653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:37 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume 7ddeba67-d489-4046-b964-f8610d602358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddeba67-d489-4046-b964-f8610d602358', 'volume_size': 1}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628610242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddeba67-d489-4046-b964-f8610d602358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:37Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Creating volume 7ddeba67-d489-4046-b964-f8610d602358 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:37 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:37 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:37 devstack sudo[112220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358 1073741824
Jun 16 19:00:37 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (04617404-b18e-4d73-92ae-dd5f01982c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e74526a-bdbd-4364-b159-ab532f2b2cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e74526a-bdbd-4364-b159-ab532f2b2cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-815102303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94bae28-540f-4337-a714-a7f7c7578ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:38Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e34d7d9-8f9f-4dc5-be14-7775df38b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e34d7d9-8f9f-4dc5-be14-7775df38b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5768993-df2b-4aa1-a279-f78d01d7f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5768993-df2b-4aa1-a279-f78d01d7f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94bae28-540f-4337-a714-a7f7c7578ae9', 'volume_name': 'volume-a94bae28-540f-4337-a714-a7f7c7578ae9', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a523abb1-ba18-4d55-8d8f-fd424b409967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a523abb1-ba18-4d55-8d8f-fd424b409967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd78b56-56a1-4027-80fb-1ae2a65f6c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume a94bae28-540f-4337-a714-a7f7c7578ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94bae28-540f-4337-a714-a7f7c7578ae9', 'volume_size': 1}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (94c2dcd3-98da-44c5-8439-91c65d679956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea2c8a9-9f1f-43d9-8f72-32309b71f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea2c8a9-9f1f-43d9-8f72-32309b71f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-327434305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320ceb83-e97b-4761-b44d-619b4b8518a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:39Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232193e0-33ae-4b23-a6e5-e35ea8b8c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232193e0-33ae-4b23-a6e5-e35ea8b8c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e17f64-07ed-482f-a30c-84f401a47461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e17f64-07ed-482f-a30c-84f401a47461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320ceb83-e97b-4761-b44d-619b4b8518a2', 'volume_name': 'volume-320ceb83-e97b-4761-b44d-619b4b8518a2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d10f18-0905-4b9d-a4d5-e28185d03d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d10f18-0905-4b9d-a4d5-e28185d03d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3b7b05-fa1a-4091-b127-9531ec09471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:38 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume 320ceb83-e97b-4761-b44d-619b4b8518a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320ceb83-e97b-4761-b44d-619b4b8518a2', 'volume_size': 1}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358 1073741824" returned: 0 in 1.240s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:38 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:38 devstack sudo[112226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358
Jun 16 19:00:38 devstack sudo[112226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (240cbd2e-0550-46bf-a1eb-8a642faeb892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a3eda-202f-47d2-97ce-3e436c8ec2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a3eda-202f-47d2-97ce-3e436c8ec2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-848556605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53e8881-a4e0-47bb-86af-78c275a27934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:39Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8e55d2-c6a9-41d4-b320-446726918f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8e55d2-c6a9-41d4-b320-446726918f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2208dc6-72a6-4a6d-8ef8-7ce384aee0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2208dc6-72a6-4a6d-8ef8-7ce384aee0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53e8881-a4e0-47bb-86af-78c275a27934', 'volume_name': 'volume-b53e8881-a4e0-47bb-86af-78c275a27934', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf86746a-52ea-4cef-b0ea-d0073a2c3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf86746a-52ea-4cef-b0ea-d0073a2c3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2c8ed8-412e-4f56-8ac4-879e470d798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume b53e8881-a4e0-47bb-86af-78c275a27934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53e8881-a4e0-47bb-86af-78c275a27934', 'volume_size': 1}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (5b21475b-a1cf-4eb9-8d82-9438ef701a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9c3765-bd95-413d-8129-b027afaf02e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9c3765-bd95-413d-8129-b027afaf02e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091135051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993ebc4e-b63b-4aee-a18d-270fe09693cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:39Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92168e24-53ec-4bf1-a862-9fcd47401da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92168e24-53ec-4bf1-a862-9fcd47401da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f1b032-c14c-4272-918f-186d49fb248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f1b032-c14c-4272-918f-186d49fb248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993ebc4e-b63b-4aee-a18d-270fe09693cc', 'volume_name': 'volume-993ebc4e-b63b-4aee-a18d-270fe09693cc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d47df62-6847-41ba-abab-f6bc4d58420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d47df62-6847-41ba-abab-f6bc4d58420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd54ac8-8c19-452d-8843-56714fa045a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume 993ebc4e-b63b-4aee-a18d-270fe09693cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993ebc4e-b63b-4aee-a18d-270fe09693cc', 'volume_size': 1}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Flow 'volume_create_manager' (e55057c5-9eb1-4989-88db-15bdca1033f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5df615-0b04-4a61-8104-6ddd7f1fd641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack sudo[112226]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358" returned: 0 in 0.863s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-815102303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94bae28-540f-4337-a714-a7f7c7578ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:38Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Creating volume a94bae28-540f-4337-a714-a7f7c7578ae9 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:39 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5df615-0b04-4a61-8104-6ddd7f1fd641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-769508722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d86e55e-4812-49dd-9315-6d551c6e07bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69888b8db704c49b22f17fdbd267d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:40Z,use_quota=True,user_id='0af69810cc2a423197a6a0ad5a7a8ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack sudo[112229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9 1073741824
Jun 16 19:00:39 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aeac29a-a731-4488-b4ee-1a6f9f3dea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aeac29a-a731-4488-b4ee-1a6f9f3dea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a773e5a2-2349-4aca-941e-d1cd9feb5495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a773e5a2-2349-4aca-941e-d1cd9feb5495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d86e55e-4812-49dd-9315-6d551c6e07bf', 'volume_name': 'volume-1d86e55e-4812-49dd-9315-6d551c6e07bf', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b73f2-2263-432f-a1bd-a5195653f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b73f2-2263-432f-a1bd-a5195653f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf093482-27fb-40fe-b1ae-2c7b9fd6e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Volume 1d86e55e-4812-49dd-9315-6d551c6e07bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d86e55e-4812-49dd-9315-6d551c6e07bf', 'volume_size': 1}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb0fed9-0229-4fd1-8229-2c2cb1358653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddeba67-d489-4046-b964-f8610d602358', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dd3694-eb71-40b8-b15c-6530eab3a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:39 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume volume-7ddeba67-d489-4046-b964-f8610d602358 (7ddeba67-d489-4046-b964-f8610d602358): created successfully
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dd3694-eb71-40b8-b15c-6530eab3a148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:39 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (4a5f6ab2-bdb8-48cd-a554-6d5fd62a5e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:39 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-75889263-de1d-4cdf-9a73-176c48a23402 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created volume successfully.
Jun 16 19:00:40 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9 1073741824" returned: 0 in 0.759s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:40 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:40 devstack sudo[112236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9
Jun 16 19:00:40 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:41 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9" returned: 0 in 0.578s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-327434305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320ceb83-e97b-4761-b44d-619b4b8518a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:39Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Creating volume 320ceb83-e97b-4761-b44d-619b4b8518a2 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:41 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:41 devstack sudo[112239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2 1073741824
Jun 16 19:00:41 devstack sudo[112239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd78b56-56a1-4027-80fb-1ae2a65f6c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94bae28-540f-4337-a714-a7f7c7578ae9', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21b063b-31b7-417e-8576-ebb3a521cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:41 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume volume-a94bae28-540f-4337-a714-a7f7c7578ae9 (a94bae28-540f-4337-a714-a7f7c7578ae9): created successfully
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21b063b-31b7-417e-8576-ebb3a521cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (04617404-b18e-4d73-92ae-dd5f01982c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:41 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-2de2d574-87eb-4fe9-8877-9b1847f7a4a1 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created volume successfully.
Jun 16 19:00:41 devstack sudo[112239]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2 1073741824" returned: 0 in 0.758s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:41 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:41 devstack sudo[112245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2
Jun 16 19:00:41 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:42 devstack sudo[112247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:42 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:42 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2" returned: 0 in 0.587s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.246s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-848556605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53e8881-a4e0-47bb-86af-78c275a27934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:39Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Creating volume b53e8881-a4e0-47bb-86af-78c275a27934 {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:42 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3b7b05-fa1a-4091-b127-9531ec09471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320ceb83-e97b-4761-b44d-619b4b8518a2', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:42 devstack sudo[112250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934 1073741824
Jun 16 19:00:42 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d28660-f49f-4c4e-a42b-b0bcff7efcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:42 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume volume-320ceb83-e97b-4761-b44d-619b4b8518a2 (320ceb83-e97b-4761-b44d-619b4b8518a2): created successfully
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d28660-f49f-4c4e-a42b-b0bcff7efcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (94c2dcd3-98da-44c5-8439-91c65d679956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:42 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-97c87adc-6ddc-4706-8e49-1fac76582399 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created volume successfully.
Jun 16 19:00:42 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.608s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG oslo_service.periodic_task [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] Running periodic task VolumeManager._thread_info {{(pid=91851) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread count: 29 {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 16 19:00:42 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-bffcb628-e09a-4c9a-ad2a-a25e48618905 None None] thread info: [<_MainThread(MainThread, started 125706757517440)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125706649389312)>, <Thread(Thread-3 (stat_writer), started daemon 125706648015360)>, <Thread(Rabbit-heartbeat, started daemon 125706646942720)>, <Thread(Thread-5 (_runner), started daemon 125706647108032)>, <Thread(Thread-7 (_runner), started daemon 125706647150592)>, <Thread(fd_logger, started daemon 125706644710464)>, <Thread(privsep_reader, started daemon 125706644033600)>, <Thread(tpool_thread_0, started daemon 125706635826880)>, <Thread(tpool_thread_1, started daemon 125706627434176)>, <Thread(tpool_thread_2, started daemon 125706619041472)>, <Thread(tpool_thread_3, started daemon 125706610648768)>, <Thread(tpool_thread_4, started daemon 125706602256064)>, <Thread(tpool_thread_5, started daemon 125706593863360)>, <Thread(tpool_thread_6, started daemon 125706585470656)>, <Thread(tpool_thread_7, started daemon 125706577077952)>, <Thread(tpool_thread_8, started daemon 125706568685248)>, <Thread(tpool_thread_9, started daemon 125706560292544)>, <Thread(tpool_thread_10, started daemon 125706551899840)>, <Thread(tpool_thread_11, started daemon 125706543507136)>, <Thread(tpool_thread_12, started daemon 125706535114432)>, <Thread(tpool_thread_13, started daemon 125706526721728)>, <Thread(tpool_thread_14, started daemon 125706518329024)>, <Thread(tpool_thread_15, started daemon 125706509919936)>, <Thread(tpool_thread_16, started daemon 125706501510848)>, <Thread(tpool_thread_17, started daemon 125706493101760)>, <Thread(tpool_thread_18, started daemon 125706484692672)>, <Thread(tpool_thread_19, started daemon 125706476283584)>, <Thread(Rabbit-heartbeat, started daemon 125706636994240)>] {{(pid=91851) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}
Jun 16 19:00:43 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934 1073741824" returned: 0 in 0.751s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:43 devstack sudo[112257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934
Jun 16 19:00:43 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:43 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934" returned: 0 in 0.597s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091135051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993ebc4e-b63b-4aee-a18d-270fe09693cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d105f246894c719027edf3dc64c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:39Z,use_quota=True,user_id='c0918531b83f452f97c86a87f159aa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Creating volume 993ebc4e-b63b-4aee-a18d-270fe09693cc {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:43 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:43 devstack sudo[112260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc 1073741824
Jun 16 19:00:43 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2c8ed8-412e-4f56-8ac4-879e470d798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53e8881-a4e0-47bb-86af-78c275a27934', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f659fd1-07a3-4b82-acb1-f7dd38e8b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:43 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume volume-b53e8881-a4e0-47bb-86af-78c275a27934 (b53e8881-a4e0-47bb-86af-78c275a27934): created successfully
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f659fd1-07a3-4b82-acb1-f7dd38e8b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:43 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (240cbd2e-0550-46bf-a1eb-8a642faeb892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:43 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-a6f083f5-7bec-4725-8df0-e92803549c4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created volume successfully.
Jun 16 19:00:44 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc 1073741824" returned: 0 in 0.746s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:44 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:44 devstack sudo[112265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc
Jun 16 19:00:44 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:45 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc" returned: 0 in 0.585s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72545c2dba10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-769508722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d86e55e-4812-49dd-9315-6d551c6e07bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69888b8db704c49b22f17fdbd267d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:40Z,use_quota=True,user_id='0af69810cc2a423197a6a0ad5a7a8ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)}" {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Creating volume 1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:45 devstack cinder-volume[91851]: INFO cinder.volume.drivers.remotefs [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] casted to osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf 1073741824 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd54ac8-8c19-452d-8843-56714fa045a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993ebc4e-b63b-4aee-a18d-270fe09693cc', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e308c-6f25-406e-8cc2-3824c142ddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:45 devstack sudo[112268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf 1073741824
Jun 16 19:00:45 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:45 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Volume volume-993ebc4e-b63b-4aee-a18d-270fe09693cc (993ebc4e-b63b-4aee-a18d-270fe09693cc): created successfully
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e308c-6f25-406e-8cc2-3824c142ddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Flow 'volume_create_manager' (5b21475b-a1cf-4eb9-8d82-9438ef701a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:45 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b1380805-9707-4773-bdc3-96b4621d68b9 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created volume successfully.
Jun 16 19:00:45 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf 1073741824" returned: 0 in 0.741s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:45 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:46 devstack sudo[112274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:00:46 devstack sudo[112274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-993ebc4e-b63b-4aee-a18d-270fe09693cc-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-993ebc4e-b63b-4aee-a18d-270fe09693cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-quobyte-993ebc4e-b63b-4aee-a18d-270fe09693cc" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-993ebc4e-b63b-4aee-a18d-270fe09693cc" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab02e4-960b-490a-88df-a271206e9f22]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:46 devstack sudo[112276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc
Jun 16 19:00:46 devstack sudo[112276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:46 devstack sudo[112274]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.609s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'} {{(pid=91851) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf093482-27fb-40fe-b1ae-2c7b9fd6e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d86e55e-4812-49dd-9315-6d551c6e07bf', 'volume_size': 1}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14c7435-979f-467d-9d02-72d3c0ed3972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:46 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Volume volume-1d86e55e-4812-49dd-9315-6d551c6e07bf (1d86e55e-4812-49dd-9315-6d551c6e07bf): created successfully
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14c7435-979f-467d-9d02-72d3c0ed3972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Flow 'volume_create_manager' (e55057c5-9eb1-4989-88db-15bdca1033f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:46 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-06ea3e21-f618-4630-9fe0-9e5b6a76e4c2 tempest-SnapshotDependencyTests-1513387390 None] Created volume successfully.
Jun 16 19:00:46 devstack sudo[112276]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:46 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:46 devstack sudo[112282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc
Jun 16 19:00:46 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Creating offline snapshot be56b17f-a9a8-4ffd-9647-ada42703f2e1 of volume 1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a7edf8-732a-489a-a9a3-e6b0e9369123]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:47 devstack sudo[112284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:00:47 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:47 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-993ebc4e-b63b-4aee-a18d-270fe09693cc" returned: 0 in 0.614s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-993ebc4e-b63b-4aee-a18d-270fe09693cc" released by "delete_volume" :: held 1.373s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created reservations ['9bb104de-bd65-4481-911e-c3e332431520', '140098b1-aba0-4bb8-81fc-0c87244a794d', 'bf41fff4-dc2b-4553-8c8b-3438be0d75d5', '5b71904f-6938-4be9-86f3-342066df54cc'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:47 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:47 devstack sudo[112287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:47 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:48 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.720s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 1G {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:48 devstack sudo[112292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 1G
Jun 16 19:00:48 devstack sudo[112292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:48 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.599s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:48 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Deleted volume successfully.
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-8f86b407-53e4-4796-9f41-573dbc8c8454 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-993ebc4e-b63b-4aee-a18d-270fe09693cc-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-b53e8881-a4e0-47bb-86af-78c275a27934-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-b53e8881-a4e0-47bb-86af-78c275a27934-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-quobyte-b53e8881-a4e0-47bb-86af-78c275a27934" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-b53e8881-a4e0-47bb-86af-78c275a27934" acquired by "delete_volume" :: waited 0.015s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b631aa5e-9d68-49aa-ae35-68681adb18aa]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:48 devstack sudo[112295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934
Jun 16 19:00:48 devstack sudo[112295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:48 devstack sudo[112292]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 1G" returned: 0 in 0.779s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:48 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d86e55e-4812-49dd-9315-6d551c6e07bf -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:48 devstack sudo[112300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d86e55e-4812-49dd-9315-6d551c6e07bf -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1
Jun 16 19:00:48 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:49 devstack sudo[112295]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934" returned: 0 in 0.732s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:49 devstack sudo[112305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934
Jun 16 19:00:49 devstack sudo[112305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:49 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d86e55e-4812-49dd-9315-6d551c6e07bf -F qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1" returned: 0 in 0.657s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:49 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 is being set with open permissions: ugo+rw
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:49 devstack sudo[112310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1
Jun 16 19:00:49 devstack sudo[112310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:49 devstack sudo[112305]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-b53e8881-a4e0-47bb-86af-78c275a27934" returned: 0 in 0.612s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-b53e8881-a4e0-47bb-86af-78c275a27934" released by "delete_volume" :: held 1.387s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created reservations ['fc29d328-dd9a-4024-a37b-d64f8325a2ad', '87b73ec7-b817-4f69-ba7c-b90f14fcd86d', 'dd48361b-55b0-4f16-87f5-4f3752ce59af', '1131cd7c-fe8f-4580-b03c-16c73b9021e9'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:49 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:49 devstack sudo[112313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:49 devstack sudo[112313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:50 devstack sudo[112310]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1" returned: 0 in 0.597s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:50 devstack sudo[112317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info
Jun 16 19:00:50 devstack sudo[112317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:50 devstack sudo[112313]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.583s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:50 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Deleted volume successfully.
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-111d5ac7-862e-43df-b212-4c2b4e000100 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-b53e8881-a4e0-47bb-86af-78c275a27934-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-320ceb83-e97b-4761-b44d-619b4b8518a2-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-320ceb83-e97b-4761-b44d-619b4b8518a2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-quobyte-320ceb83-e97b-4761-b44d-619b4b8518a2" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-320ceb83-e97b-4761-b44d-619b4b8518a2" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0598c6-81f9-4ca7-a0d0-dc964987d7ce]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:50 devstack sudo[112317]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info" returned: 0 in 0.603s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:50 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info is being set with open permissions: ugo+rw
Jun 16 19:00:50 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:50 devstack sudo[112321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2
Jun 16 19:00:50 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:50 devstack sudo[112323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info
Jun 16 19:00:50 devstack sudo[112323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:51 devstack sudo[112323]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.info" returned: 0 in 0.601s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:51 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.041s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2" returned: 0 in 0.725s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:51 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:51 devstack sudo[112329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2
Jun 16 19:00:51 devstack sudo[112329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:51 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-02f21158-018e-40a6-8e12-21ab4d10bea4 tempest-SnapshotDependencyTests-1513387390 None] Create snapshot completed successfully
Jun 16 19:00:52 devstack sudo[112329]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-320ceb83-e97b-4761-b44d-619b4b8518a2" returned: 0 in 0.636s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-320ceb83-e97b-4761-b44d-619b4b8518a2" released by "delete_volume" :: held 1.403s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.flows.manager.create_volume [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91851) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Flow 'volume_create_manager' (92b817e6-b865-432b-9efe-6acff938e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40105f2-bb85-45fd-b105-d2fd62896c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40105f2-bb85-45fd-b105-d2fd62896c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-16T17:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa64840-87c3-4b69-8bb7-060a8a6d6a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69888b8db704c49b22f17fdbd267d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T17:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be56b17f-a9a8-4ffd-9647-ada42703f2e1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T17:00:52Z,use_quota=True,user_id='0af69810cc2a423197a6a0ad5a7a8ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac46cd61-59d8-453f-a282-41f3f2fdf210),volume_type_id=ac46cd61-59d8-453f-a282-41f3f2fdf210)' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b170670-8940-4d41-ad47-88ccc683a7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b170670-8940-4d41-ad47-88ccc683a7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc26ad4-01da-4253-9ce8-6ce968d2098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc26ad4-01da-4253-9ce8-6ce968d2098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fa64840-87c3-4b69-8bb7-060a8a6d6a11', 'volume_name': 'volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11', 'volume_size': 1, 'snapshot_id': 'be56b17f-a9a8-4ffd-9647-ada42703f2e1'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8cee40-f032-48d0-8e00-7500dd95ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8cee40-f032-48d0-8e00-7500dd95ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa9c45c-21a2-4ad9-aebc-2668df43d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:00:52 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Volume 3fa64840-87c3-4b69-8bb7-060a8a6d6a11: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11', 'volume_size': 1, 'snapshot_id': 'be56b17f-a9a8-4ffd-9647-ada42703f2e1'}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-quobyte-be56b17f-a9a8-4ffd-9647-ada42703f2e1-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" by "_create_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created reservations ['2dd0cd8f-271d-45d6-a35b-2a90b2dfa251', '9852dbe4-6d28-49a7-8213-be6531bc8437', '24a545b7-eabf-4b6c-9ba7-b27823e1766e', 'b68b6d3a-0da7-4657-aa8e-24023cde937a'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-be56b17f-a9a8-4ffd-9647-ada42703f2e1-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Creating volume 3fa64840-87c3-4b69-8bb7-060a8a6d6a11 from snapshot be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Selected osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798 as target Quobyte volume. {{(pid=91851) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-quobyte-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" by "_copy_volume_from_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] snapshot: be56b17f-a9a8-4ffd-9647-ada42703f2e1, volume: 3fa64840-87c3-4b69-8bb7-060a8a6d6a11,  {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f1e2a-8641-42dd-a854-37db8c6ebc06]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:52 devstack sudo[112333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:52 devstack sudo[112333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:52 devstack sudo[112332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1
Jun 16 19:00:52 devstack sudo[112332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-a94bae28-540f-4337-a714-a7f7c7578ae9-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-a94bae28-540f-4337-a714-a7f7c7578ae9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-quobyte-a94bae28-540f-4337-a714-a7f7c7578ae9" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-a94bae28-540f-4337-a714-a7f7c7578ae9" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee4c45-e3f7-4ad6-af98-2af1aeb199a7]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:52 devstack sudo[112333]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.644s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:52 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Deleted volume successfully.
Jun 16 19:00:52 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-02748c53-61eb-4104-b4df-86c561c50723 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-320ceb83-e97b-4761-b44d-619b4b8518a2-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:53 devstack sudo[112340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9
Jun 16 19:00:53 devstack sudo[112340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:53 devstack sudo[112332]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1" returned: 0 in 0.784s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d86e55e-4812-49dd-9315-6d551c6e07bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Creating direct copy from snapshot {{(pid=91851) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7b609-57e7-41a6-aef7-d2bc36415690]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:53 devstack sudo[112343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:00:53 devstack sudo[112343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:53 devstack sudo[112340]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9" returned: 0 in 0.717s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:53 devstack sudo[112349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9
Jun 16 19:00:53 devstack sudo[112349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:53 devstack sudo[112343]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.722s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG cinder.utils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Path /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 not found in is_blk_device check {{(pid=91851) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 16 19:00:53 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:53 devstack sudo[112353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11
Jun 16 19:00:53 devstack sudo[112353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:54 devstack sudo[112349]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-a94bae28-540f-4337-a714-a7f7c7578ae9" returned: 0 in 0.610s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-a94bae28-540f-4337-a714-a7f7c7578ae9" released by "delete_volume" :: held 1.374s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created reservations ['e56080b6-4e31-4941-b65a-d02033f313ca', '7c59cd19-8a58-4fb8-8706-d52c5b913afb', '2a4dad7c-cf16-4971-b2a8-78e6f174f9d1', 'a43656ca-482e-4fb0-9b81-d305e1f16a96'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:54 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:54 devstack sudo[112359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:54 devstack sudo[112359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-7ddeba67-d489-4046-b964-f8610d602358-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-7ddeba67-d489-4046-b964-f8610d602358-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-quobyte-7ddeba67-d489-4046-b964-f8610d602358" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-7ddeba67-d489-4046-b964-f8610d602358" acquired by "delete_volume" :: waited 0.045s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b021054-d3c4-4750-98a1-b09a66b1ad98]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:55 devstack sudo[112359]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 1.288s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:55 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Deleted volume successfully.
Jun 16 19:00:55 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-7418fae0-712d-4058-926e-2a866f253619 tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-a94bae28-540f-4337-a714-a7f7c7578ae9-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:55 devstack sudo[112369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358
Jun 16 19:00:55 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:57 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358" returned: 0 in 1.761s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:57 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:57 devstack sudo[112375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358
Jun 16 19:00:57 devstack sudo[112375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:58 devstack sudo[112375]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-7ddeba67-d489-4046-b964-f8610d602358" returned: 0 in 1.029s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-7ddeba67-d489-4046-b964-f8610d602358" released by "delete_volume" :: held 2.901s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created reservations ['96abeb2e-9e84-41af-b9af-2ef6cf2203d1', 'f33d5126-3f27-4118-98ae-2c4c56a84af1', 'edf40c3c-8856-4803-a951-6881870afac3', 'f84191a5-418b-457e-aa37-742507e0c589'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:58 devstack sudo[112378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:00:58 devstack sudo[112378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-4d510dd5-5fbc-4c34-8c2c-b32520153b1b-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-4d510dd5-5fbc-4c34-8c2c-b32520153b1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "cinder-quobyte-4d510dd5-5fbc-4c34-8c2c-b32520153b1b" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-4d510dd5-5fbc-4c34-8c2c-b32520153b1b" acquired by "delete_volume" :: waited 0.028s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f6cd9-3ffa-4dcf-89a3-96c73a014504]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:58 devstack sudo[112353]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" returned: 0 in 5.185s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:58 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[5936f5bb-2b93-4cab-ad40-023e42dae22a]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:59 devstack sudo[112380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b
Jun 16 19:00:59 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:59 devstack sudo[112381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:00:59 devstack sudo[112381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:59 devstack sudo[112378]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.696s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:00:59 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Deleted volume successfully.
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-738de46f-207f-4b76-8e49-762220a9cbfe tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-7ddeba67-d489-4046-b964-f8610d602358-delete_volume" released by "delete_volume" :: held 4.090s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:00:59 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b" returned: 0 in 0.727s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:59 devstack sudo[112390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b
Jun 16 19:00:59 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:00:59 devstack sudo[112381]: pam_unix(sudo:session): session closed for user root
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.875s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG cinder.image.image_utils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Image conversion details: src /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 {{(pid=91851) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 16 19:00:59 devstack cinder-volume[91851]: INFO cinder.image.image_utils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Converted 1024.00 MB image at 197.45 MB/s
Jun 16 19:00:59 devstack cinder-volume[91851]: WARNING cinder.volume.drivers.remotefs [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 is being set with open permissions: ugo+rw
Jun 16 19:00:59 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:00:59 devstack sudo[112393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11
Jun 16 19:00:59 devstack sudo[112393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:00 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-4d510dd5-5fbc-4c34-8c2c-b32520153b1b" returned: 0 in 0.606s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-quobyte-4d510dd5-5fbc-4c34-8c2c-b32520153b1b" released by "delete_volume" :: held 1.383s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Created reservations ['64db561b-6aaa-4eb5-895b-36596380863e', '184e730c-728e-4861-a8a9-ebe314d9f814', '6665412b-eb3b-4078-bb7d-7a493d1d7b71', '99e772dd-094d-419a-a4c8-2b1af8b889f5'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:00 devstack sudo[112398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:01:00 devstack sudo[112398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:00 devstack sudo[112393]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" returned: 0 in 0.634s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" released by "_copy_volume_from_snapshot" :: held 8.296s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-be56b17f-a9a8-4ffd-9647-ada42703f2e1-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" released by "_create_volume_from_snapshot" :: held 8.336s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.358s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa9c45c-21a2-4ad9-aebc-2668df43d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11', 'volume_size': 1, 'snapshot_id': 'be56b17f-a9a8-4ffd-9647-ada42703f2e1'}' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3754bd-0824-4795-9c38-2812646def47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 16 19:01:00 devstack cinder-volume[91851]: INFO cinder.volume.flows.manager.create_volume [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Volume volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 (3fa64840-87c3-4b69-8bb7-060a8a6d6a11): created successfully
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3754bd-0824-4795-9c38-2812646def47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91851) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Flow 'volume_create_manager' (92b817e6-b865-432b-9efe-6acff938e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91851) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 16 19:01:00 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-4874d7ab-92de-4f51-b329-6a0e6928b2ea tempest-SnapshotDependencyTests-1513387390 None] Created volume successfully.
Jun 16 19:01:00 devstack sudo[112398]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.601s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:00 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:01:01 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Deleted volume successfully.
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-405957cf-c9ab-4e44-a550-da4626c07a4c tempest-CreateVolumesFromSourceVolumeTest-240480564 None] Lock "cinder-4d510dd5-5fbc-4c34-8c2c-b32520153b1b-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-be56b17f-a9a8-4ffd-9647-ada42703f2e1-delete_snapshot" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-be56b17f-a9a8-4ffd-9647-ada42703f2e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-quobyte-1d86e55e-4812-49dd-9315-6d551c6e07bf" by "delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-1d86e55e-4812-49dd-9315-6d551c6e07bf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-quobyte-be56b17f-a9a8-4ffd-9647-ada42703f2e1" by "_delete_snapshot" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-be56b17f-a9a8-4ffd-9647-ada42703f2e1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Deleting offline snapshot be56b17f-a9a8-4ffd-9647-ada42703f2e1 of volume 1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] snapshot_file for this snap is: volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf589e-e108-4def-bc24-03bfb1d9ea07]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:01 devstack sudo[112401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1
Jun 16 19:01:01 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:01 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1" returned: 0 in 0.732s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.remotefs [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d86e55e-4812-49dd-9315-6d551c6e07bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91851) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415afba-b3e0-49e7-bbb7-00b5fa3907ae]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:01:01 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:02 devstack sudo[112406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:01:02 devstack sudo[112406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:02 devstack sudo[112406]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.709s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:02 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:02 devstack sudo[112411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1
Jun 16 19:01:02 devstack sudo[112411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:03 devstack sudo[112411]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1" returned: 0 in 0.673s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:03 devstack sudo[112417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1
Jun 16 19:01:03 devstack sudo[112417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:03 devstack sudo[112417]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:03 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf.be56b17f-a9a8-4ffd-9647-ada42703f2e1" returned: 0 in 0.588s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-be56b17f-a9a8-4ffd-9647-ada42703f2e1" released by "_delete_snapshot" :: held 2.812s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:03 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-1d86e55e-4812-49dd-9315-6d551c6e07bf" released by "delete_snapshot" :: held 2.838s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Created reservations ['dda9a638-67a0-434e-afb9-351e6fcb3d36', '7c0355c9-8b2d-4cb2-bfd9-32db4e65e640', '8f29e60b-62c5-44ea-a9cc-2b407362ee33', '18e84baf-c484-4346-8e8e-5e479419e9a7'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:01:04 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Delete snapshot completed successfully.
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-13114254-f090-4b03-8f96-8b437b8171b3 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-be56b17f-a9a8-4ffd-9647-ada42703f2e1-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-1d86e55e-4812-49dd-9315-6d551c6e07bf-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-1d86e55e-4812-49dd-9315-6d551c6e07bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-quobyte-1d86e55e-4812-49dd-9315-6d551c6e07bf" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-1d86e55e-4812-49dd-9315-6d551c6e07bf" acquired by "delete_volume" :: waited 0.016s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d5ee3-4aef-410a-92fc-0debdfa8b89d]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:01:04 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:04 devstack sudo[112421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:01:04 devstack sudo[112421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:05 devstack sudo[112421]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.705s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:05 devstack sudo[112426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf
Jun 16 19:01:05 devstack sudo[112426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:05 devstack sudo[112426]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-1d86e55e-4812-49dd-9315-6d551c6e07bf" returned: 0 in 0.593s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-1d86e55e-4812-49dd-9315-6d551c6e07bf" released by "delete_volume" :: held 1.353s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Created reservations ['9830b0c4-ba83-4d4b-930e-489b7d8a3d12', '5ffd498d-97e3-4aa8-ad5b-0b82a80eca61', '48e3def5-9f1e-4df0-bf75-104f4cc9c8dc', '14ad27e2-548b-4f8d-80ea-18309337f83a'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:01:05 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:05 devstack sudo[112429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:01:05 devstack sudo[112429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:06 devstack sudo[112429]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.566s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:01:06 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Deleted volume successfully.
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-b61f136e-9e9a-41a6-b685-5d389b3f6102 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-1d86e55e-4812-49dd-9315-6d551c6e07bf-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-3fa64840-87c3-4b69-8bb7-060a8a6d6a11-delete_volume" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-3fa64840-87c3-4b69-8bb7-060a8a6d6a11-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "cinder-quobyte-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" by "delete_volume" {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" acquired by "delete_volume" :: waited 0.014s {{(pid=91851) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b94b37d-6b1d-4ab4-9ad5-37451f6932ae]: (4, 'qcow2') {{(pid=92926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 16 19:01:06 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:06 devstack sudo[112432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11
Jun 16 19:01:06 devstack sudo[112432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:07 devstack sudo[112432]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" returned: 0 in 0.716s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:07 devstack sudo[112437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11
Jun 16 19:01:07 devstack sudo[112437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:07 devstack sudo[112437]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:07 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624/volume-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" returned: 0 in 0.602s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:07 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-quobyte-3fa64840-87c3-4b69-8bb7-060a8a6d6a11" released by "delete_volume" :: held 1.356s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG cinder.quota [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Created reservations ['381056a2-b70a-4c2f-b4c4-e10d42a8d6ba', '6f2338b5-e8f4-4fd0-86d2-6559f089b800', '2a5d9b55-6011-4f4d-9cb4-adada176d917', '629feba2-47cc-4f21-8cf4-527ed8fcee1e'] {{(pid=91851) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798': None} {{(pid=91851) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG cinder.volume.drivers.quobyte [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b67057f0-0c2a-4b1a-b625-987f2989e798'] {{(pid=91851) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.lockutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91851) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624 {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 16 19:01:08 devstack sudo[112440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624
Jun 16 19:01:08 devstack sudo[112440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 16 19:01:08 devstack sudo[112440]: pam_unix(sudo:session): session closed for user root
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG oslo_concurrency.processutils [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7167828953845c6cc71b3458079e0624" returned: 0 in 0.572s {{(pid=91851) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG cinder.manager [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Notifying Schedulers of capabilities ... {{(pid=91851) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 16 19:01:08 devstack cinder-volume[91851]: INFO cinder.volume.manager [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Deleted volume successfully.
Jun 16 19:01:08 devstack cinder-volume[91851]: DEBUG cinder.coordination [None req-49328f53-3f7e-4191-ad8f-23e688bc8d72 tempest-SnapshotDependencyTests-1513387390 None] Lock "cinder-3fa64840-87c3-4b69-8bb7-060a8a6d6a11-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=91851) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 16 19:01:18 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:SELECT=79,cinder:INSERT=28,cinder:UPDATE=114,cinder:DELETE=7 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 16 19:01:18 devstack cinder-volume[91851]: DEBUG dbcounter [-] [91851] Writing DB stats cinder:INSERT=24,cinder:UPDATE=105,cinder:SELECT=68,cinder:DELETE=12 {{(pid=91851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}